[ 538.737096] env[70013]: INFO neutron.common.config [-] Logging enabled! [ 538.737359] env[70013]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev15 [ 538.737562] env[70013]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=70013) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 538.737854] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 538.737954] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 538.738863] env[70013]: WARNING oslo_policy.policy [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 538.739111] env[70013]: WARNING oslo_policy.policy [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 538.740635] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] VMware NSXv3 Agent initialized successfully. [ 538.740986] env[70013]: DEBUG oslo_concurrency.lockutils [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] Acquiring lock "singleton_lock" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 538.741137] env[70013]: DEBUG oslo_concurrency.lockutils [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] Acquired lock "singleton_lock" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 538.741346] env[70013]: DEBUG oslo_concurrency.lockutils [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] Releasing lock "singleton_lock" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 538.741642] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] Full set of CONF: {{(pid=70013) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 538.741851] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ******************************************************************************** {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 538.741971] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] Configuration options gathered from: {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 538.742220] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 538.742397] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 538.742513] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ================================================================================ {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 538.742691] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] agent_down_time = 75 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.742855] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] allow_automatic_dhcp_failover = True {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.742998] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] allow_bulk = True {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.743164] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] api_extensions_path = {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.743314] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] api_paste_config = api-paste.ini {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.743462] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] auth_strategy = keystone {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.743578] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] backdoor_port = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.743688] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] backdoor_socket = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.743832] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] backlog = 4096 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.743979] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] base_mac = fa:16:3e:00:00:00 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.744158] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] bind_host = 0.0.0.0 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.744307] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] bind_port = 9696 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.744452] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] client_socket_timeout = 900 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.744600] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] config_dir = [] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.744717] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.744861] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] config_source = [] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.745028] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] control_exchange = neutron {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.745168] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] core_plugin = ml2 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.745314] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] debug = True {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.745460] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] default_availability_zones = [] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.745885] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.745885] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] dhcp_agent_notification = True {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.746036] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] dhcp_agents_per_network = 1 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.746097] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] dhcp_lease_duration = 86400 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.746243] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] dhcp_load_type = networks {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.746387] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] dns_domain = openstacklocal {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.746531] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.746671] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] enable_default_route_bfd = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.746808] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] enable_default_route_ecmp = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.746946] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] enable_dvr = True {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.747094] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] enable_new_agents = True {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.747232] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] enable_services_on_agents_with_admin_state_down = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.747369] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] enable_signals = True {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.747505] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] enable_traditional_dhcp = True {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.747641] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] external_dns_driver = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.747776] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] filter_validation = True {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.747923] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] global_physnet_mtu = 8950 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.748075] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] graceful_shutdown_timeout = 60 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.748258] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] host = cpu-1 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.748425] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] host_dvr_for_dhcp = True {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.748577] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] http_retries = 3 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.748727] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] instance_format = [instance: %(uuid)s] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.748871] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.749024] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ipam_driver = internal {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.749167] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ipv6_pd_enabled = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.749307] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] l3_ha = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.749451] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.749593] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] l3_ha_network_physical_name = {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.749737] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] l3_ha_network_type = {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.749882] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] log_color = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.750031] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] log_config_append = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.750178] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.750316] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] log_dir = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.750485] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] log_file = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.750593] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] log_options = True {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.750745] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] log_rotate_interval = 1 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.750897] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] log_rotate_interval_type = days {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.751051] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] log_rotation_type = none {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.751167] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.751279] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.751427] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.751572] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.751683] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.751822] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] max_dns_nameservers = 5 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.751961] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] max_header_line = 16384 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.752119] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] max_l3_agents_per_router = 3 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.752258] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] max_logfile_count = 30 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.752397] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] max_logfile_size_mb = 200 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.752534] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] max_subnet_host_routes = 20 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.752684] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] my_ip = 10.180.1.21 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.752848] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] my_ipv6 = ::1 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.753013] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] network_auto_schedule = True {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.753158] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] network_link_prefix = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.753320] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.753471] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] notify_nova_on_port_data_changes = True {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.753619] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] notify_nova_on_port_status_changes = True {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.753765] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] pagination_max_limit = -1 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.753906] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] publish_errors = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.754056] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] rate_limit_burst = 0 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.754205] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] rate_limit_except_level = CRITICAL {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.754345] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] rate_limit_interval = 0 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.754495] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] retry_until_window = 30 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.754626] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] router_distributed = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.754763] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] rpc_resources_processing_step = 20 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.754901] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] rpc_response_max_timeout = 600 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.755068] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] rpc_response_timeout = 60 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.755185] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] send_events_interval = 2 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.755341] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] service_plugins = ['router'] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.755489] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] setproctitle = on {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.755627] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] shell_completion = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.755768] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] state_path = /opt/stack/data/neutron {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.755911] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] syslog_log_facility = LOG_USER {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.756065] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] tcp_keepidle = 600 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.756213] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] transport_url = **** {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.756354] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] use_journal = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.756491] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] use_json = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.756629] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] use_ssl = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.756765] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] use_stderr = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.756914] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] use_syslog = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.757055] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] vlan_qinq = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.757194] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] vlan_transparent = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.757332] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] watch_log_file = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.757471] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] wsgi_default_pool_size = 100 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.757612] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] wsgi_keep_alive = True {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.757758] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.757898] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] wsgi_server_debug = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 538.758063] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_concurrency.disable_process_locking = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.758217] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.758380] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.758528] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.758680] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.758827] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.758970] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.759176] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] profiler.connection_string = messaging:// {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.759288] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] profiler.enabled = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.759437] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] profiler.es_doc_type = notification {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.759581] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] profiler.es_scroll_size = 10000 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.759730] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] profiler.es_scroll_time = 2m {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.759870] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] profiler.filter_error_trace = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.760020] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] profiler.hmac_keys = **** {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.760168] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] profiler.sentinel_service_name = mymaster {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.760319] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] profiler.socket_timeout = 0.1 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.760465] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] profiler.trace_requests = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.760625] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] profiler.trace_sqlalchemy = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.760783] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] profiler_jaeger.process_tags = {} {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.760923] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] profiler_jaeger.service_name_prefix = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.761079] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] profiler_otlp.service_name_prefix = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.761236] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_policy.enforce_new_defaults = True {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.761522] env[70013]: WARNING oslo_config.cfg [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 538.761695] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_policy.enforce_scope = True {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.761851] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_policy.policy_default_rule = default {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.762022] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.762178] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.762330] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.762473] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.762614] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.762752] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.762904] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.763064] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_policy.remote_timeout = 60.0 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.763221] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.763374] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] agent.extensions = [] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.763568] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.763662] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] service_providers.service_provider = [] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.763813] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] QUOTAS.default_quota = -1 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.763959] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.764115] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] QUOTAS.quota_floatingip = 50 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.764257] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] QUOTAS.quota_network = 100 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.764396] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] QUOTAS.quota_port = 500 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.764536] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] QUOTAS.quota_rbac_policy = 10 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.764675] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] QUOTAS.quota_router = 10 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.764814] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] QUOTAS.quota_security_group = 10 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.764955] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] QUOTAS.quota_security_group_rule = 100 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.765109] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] QUOTAS.quota_subnet = 100 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.765247] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] QUOTAS.track_quota_usage = True {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.765399] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.765544] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep.group = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.765677] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep.helper_command = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.765826] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep.logger_name = oslo_privsep.daemon {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.765970] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep.thread_pool_size = 8 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.766118] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep.user = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.766269] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.766408] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_dhcp_release.group = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.766546] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_dhcp_release.helper_command = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.766694] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.766838] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.766978] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_dhcp_release.user = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.767139] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.767280] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_ovs_vsctl.group = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.767419] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_ovs_vsctl.helper_command = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.767564] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.767731] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.767842] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_ovs_vsctl.user = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.767987] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_namespace.capabilities = [21] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.768134] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_namespace.group = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.768271] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_namespace.helper_command = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.768415] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.768556] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_namespace.thread_pool_size = 8 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.768697] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_namespace.user = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.768851] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_conntrack.capabilities = [12] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.768979] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_conntrack.group = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.769127] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_conntrack.helper_command = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.769271] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.769414] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_conntrack.thread_pool_size = 8 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.769549] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_conntrack.user = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.769699] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_link.capabilities = [12, 21] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.769833] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_link.group = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.769966] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_link.helper_command = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.770117] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.770258] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_link.thread_pool_size = 8 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.770389] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] privsep_link.user = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.770578] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.770735] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.770880] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] AGENT.continue_on_failed_promotions = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.771030] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] AGENT.dscp = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.771177] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] AGENT.dscp_inherit = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.771363] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] AGENT.force_mp_to_policy = True {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.771518] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] AGENT.locking_coordinator_url = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.771664] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] AGENT.log_agent_heartbeats = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.771806] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] AGENT.logging_expire = 1 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.771952] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.772109] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.772259] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] AGENT.polling_interval = 240 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.772404] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.772553] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] AGENT.quitting_rpc_timeout = 120 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.772700] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] AGENT.report_interval = 30.0 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.772866] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.773034] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.773186] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.773332] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] AGENT.sync_skew = 60 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.773477] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] AGENT.synchronization_queue_size = 20 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.773624] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] AGENT.use_helper_for_ns_read = True {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.773771] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] SECURITYGROUP.enable_ipset = True {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.773920] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] SECURITYGROUP.enable_security_group = True {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.774079] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.774267] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.774373] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] experimental.ipv6_pd_enabled = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.774536] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ml2.extension_drivers = ['port_security'] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.774680] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ml2.external_network_type = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.774836] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.774987] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ml2.overlay_ip_version = 4 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.775150] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ml2.path_mtu = 8950 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.775313] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ml2.physical_network_mtus = {} {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.775452] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ml2.tenant_network_types = ['vlan'] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.775602] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.775757] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ml2.type_drivers = ['vlan'] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.775910] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] AGENT_CLI.neutron_port_id = [] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.776065] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.776214] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.776369] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.776520] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.776669] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.776821] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.776973] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.777135] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.777331] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.777529] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] NSXV3.nsxv3_login_password = **** {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.777639] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] NSXV3.nsxv3_login_port = 443 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.777793] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] NSXV3.nsxv3_login_user = admin {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.777945] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.778121] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.778253] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.778400] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.778551] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.778707] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.778859] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.779036] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.779164] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.779314] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.779469] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.779691] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.779871] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.780082] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.780242] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] vsphere.vsphere_login_password = VMware1! {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.780395] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.780568] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.780733] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] nova.auth_section = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.780889] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] nova.auth_type = password {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.781052] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.781199] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] nova.certfile = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.781346] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] nova.collect_timing = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.781497] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] nova.endpoint_type = public {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.781646] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] nova.insecure = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.781786] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] nova.keyfile = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.781934] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] nova.region_name = RegionOne {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.782093] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] nova.split_loggers = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.782238] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] nova.timeout = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.782399] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] placement.auth_section = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.782553] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] placement.auth_type = password {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.782703] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.782856] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] placement.certfile = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.783008] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] placement.collect_timing = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.783740] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] placement.endpoint_type = public {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.783909] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] placement.insecure = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.784095] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] placement.keyfile = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.784246] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] placement.region_name = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.784393] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] placement.split_loggers = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.784536] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] placement.timeout = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.784690] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ironic.auth_section = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.784836] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ironic.auth_type = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.784977] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ironic.cafile = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.785128] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ironic.certfile = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.785274] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ironic.collect_timing = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.785414] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ironic.connect_retries = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.785556] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ironic.connect_retry_delay = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.785702] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ironic.enable_notifications = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.785841] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ironic.endpoint_override = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.785986] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ironic.insecure = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.786138] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ironic.interface = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.786278] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ironic.keyfile = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.786417] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ironic.max_version = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.786555] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ironic.min_version = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.786695] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ironic.region_name = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.786834] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ironic.retriable_status_codes = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.786971] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ironic.service_name = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.787121] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ironic.service_type = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.787268] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ironic.split_loggers = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.787408] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ironic.status_code_retries = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.787549] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ironic.status_code_retry_delay = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.787690] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ironic.timeout = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.787830] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ironic.valid_interfaces = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.787968] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ironic.version = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.788128] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] cli_script.dry_run = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.788288] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.788485] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.788683] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.788839] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.788986] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.789145] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.789289] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.789433] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.789576] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.790274] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.790274] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.790274] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.790274] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.790423] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.790461] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.790602] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.791240] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.791240] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.791240] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.791240] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.791379] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.791478] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.791617] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.791772] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.791917] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.792068] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.792211] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.792353] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.792494] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.792640] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.792782] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.ssl = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.792929] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.793122] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.793230] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.793380] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.793528] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.ssl_version = {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.793672] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.793824] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_notifications.driver = [] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.793968] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_notifications.retry = -1 {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.794137] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.794279] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] oslo_messaging_notifications.transport_url = **** {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 538.794391] env[70013]: DEBUG oslo_service.backend.eventlet.service [None req-399a7929-8c44-46ee-8e4d-f1299c6be90b None None] ******************************************************************************** {{(pid=70013) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 538.795363] env[70013]: DEBUG neutron.agent.securitygroups_rpc [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Init firewall settings (driver=nsxv3) {{(pid=70013) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 538.796694] env[70013]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=70013) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 538.796935] env[70013]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] RPC agent_id: nsxm-l-01a.corp.local [ 538.799181] env[70013]: DEBUG dogpile.cache.region [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 538.799309] env[70013]: DEBUG dogpile.lock [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 538.799397] env[70013]: DEBUG dogpile.lock [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 538.799490] env[70013]: DEBUG dogpile.lock [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 538.799589] env[70013]: DEBUG dogpile.cache.region [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 538.799681] env[70013]: DEBUG dogpile.lock [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 538.799807] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 538.846414] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Session token - acquiring [ 538.847929] env[70013]: DEBUG networking_nsxv3.common.locking [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 538.848156] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 538.848231] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 538.848682] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 538.859501] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 539.130081] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 539.153241] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 539.153241] env[70013]: DEBUG dogpile.cache.region [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Cache value generated in 0.353 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 539.153427] env[70013]: DEBUG dogpile.lock [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 539.153534] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Activating Policy API Provider. [ 539.153744] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Looking for the default Infrastructure Rules. [ 539.222024] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Looking for the Default Layer3 Logged Drop Section. [ 539.235501] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 539.235935] env[70013]: DEBUG networking_nsxv3.common.locking [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.236114] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Acquiring lock "all" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.236219] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Acquired lock "all" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 539.236497] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Acquired external semaphore "all" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 539.236820] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 539.752114] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 540.254055] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 540.755789] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Inventory metadata is going to be refreshed. [ 540.756182] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 541.516568] env[70013]: DEBUG networking_nsxv3.common.locking [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 541.516937] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 541.516937] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 541.517213] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 541.529342] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 541.635791] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 541.636677] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 541.656026] env[70013]: DEBUG networking_nsxv3.common.locking [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 541.656260] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 541.656303] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 541.656620] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 541.656739] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 541.656888] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 541.657012] env[70013]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=70013) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 541.657125] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 541.680915] env[70013]: DEBUG networking_nsxv3.common.locking [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 541.681127] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 541.681247] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 541.681471] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 541.681649] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 541.681784] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 541.701595] env[70013]: DEBUG networking_nsxv3.common.locking [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 541.701849] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 541.701891] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 541.702162] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 541.702307] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 541.702447] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 541.724457] env[70013]: DEBUG networking_nsxv3.common.locking [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 541.724661] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Acquiring lock "Address Group" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 541.724781] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Acquired lock "Address Group" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 541.725054] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Acquired external semaphore "Address Group" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 541.725197] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Releasing lock "Address Group" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 541.725346] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 541.725455] env[70013]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=70013) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 541.725563] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 541.743216] env[70013]: DEBUG networking_nsxv3.common.locking [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 541.743451] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Acquiring lock "Segment QoS" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 541.743495] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Acquired lock "Segment QoS" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 541.743752] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Acquired external semaphore "Segment QoS" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 541.743876] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Releasing lock "Segment QoS" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 541.744023] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 541.744132] env[70013]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=70013) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 541.744238] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 541.763214] env[70013]: DEBUG networking_nsxv3.common.locking [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 541.763541] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 541.763541] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 541.763697] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 541.763828] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 541.763967] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 541.764090] env[70013]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70013) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 541.764208] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Inventory metadata have been refreshed. [ 541.764312] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Dryrun:True. Metadata refresh completed. [ 541.764430] env[70013]: DEBUG oslo_concurrency.lockutils [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Releasing lock "all" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 541.766086] env[70013]: INFO neutron.agent.agent_extensions_manager [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Loaded agent extensions: [] [ 541.766928] env[70013]: DEBUG neutron_lib.callbacks.manager [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=70013) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 541.821602] env[70013]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] NSXv3 Agent Agent RPC Daemon Started! [ 541.821779] env[70013]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] NSXv3 Agent Agent loop - iteration:0 started [ 541.821839] env[70013]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] NSXv3 Agent Agent out of sync with plugin! [ 546.766950] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 546.767336] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 551.768525] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 551.768853] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 555.723403] env[70013]: INFO networking_nsxv3.common.synchronization [None req-8827b96d-b16e-4236-99dd-518e4ff24690 demo admin] Enqueued Resource ID: d94b542f-af76-41c5-a814-ce63f1659c55 with Priority: HIGHEST for action security_group_rules [ 555.723909] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d94b542f-af76-41c5-a814-ce63f1659c55 with Priority: HIGHEST for action security_group_rules [ 555.725272] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d94b542f-af76-41c5-a814-ce63f1659c55 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.725272] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d94b542f-af76-41c5-a814-ce63f1659c55" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.725272] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d94b542f-af76-41c5-a814-ce63f1659c55" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 555.725272] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d94b542f-af76-41c5-a814-ce63f1659c55" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 555.725272] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d94b542f-af76-41c5-a814-ce63f1659c55',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 556.245766] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.245766] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.245766] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 556.245766] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 556.245766] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.245766] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d94b542f-af76-41c5-a814-ce63f1659c55 already deleted. [ 556.245766] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d94b542f-af76-41c5-a814-ce63f1659c55" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 560.725635] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 560.725972] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 565.727175] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 565.727419] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 570.729266] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 570.729266] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 575.730949] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 575.731346] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 580.731995] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 580.732359] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 582.975025] env[70013]: INFO networking_nsxv3.common.synchronization [None req-0ac05ba1-598b-430a-a31b-140c4957d819 None None] Enqueued Resource ID: 0e0332fe-3fc6-4abc-89d3-2954b03294fe with Priority: HIGHEST for action port [ 582.976610] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e0332fe-3fc6-4abc-89d3-2954b03294fe with Priority: HIGHEST for action port [ 582.976610] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e0332fe-3fc6-4abc-89d3-2954b03294fe taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.976610] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e0332fe-3fc6-4abc-89d3-2954b03294fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.976610] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e0332fe-3fc6-4abc-89d3-2954b03294fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.976610] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e0332fe-3fc6-4abc-89d3-2954b03294fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.976610] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e0332fe-3fc6-4abc-89d3-2954b03294fe',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.479406] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e0332fe-3fc6-4abc-89d3-2954b03294fe [ 583.479647] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.479836] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.479906] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.480126] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.480201] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.480350] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e0332fe-3fc6-4abc-89d3-2954b03294fe already deleted. [ 583.480467] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e0332fe-3fc6-4abc-89d3-2954b03294fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.763705] env[70013]: INFO networking_nsxv3.common.synchronization [None req-92161b20-3448-47d3-a812-21720e2ee595 None None] Enqueued Resource ID: c8048a42-faa2-488a-a574-b00127a0261d with Priority: HIGHEST for action port [ 584.763705] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8048a42-faa2-488a-a574-b00127a0261d with Priority: HIGHEST for action port [ 584.764219] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8048a42-faa2-488a-a574-b00127a0261d taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.764505] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8048a42-faa2-488a-a574-b00127a0261d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.764672] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8048a42-faa2-488a-a574-b00127a0261d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.765063] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8048a42-faa2-488a-a574-b00127a0261d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.765260] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8048a42-faa2-488a-a574-b00127a0261d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.267604] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c8048a42-faa2-488a-a574-b00127a0261d [ 585.267693] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.267780] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.267867] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.269250] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.269404] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.269474] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c8048a42-faa2-488a-a574-b00127a0261d already deleted. [ 585.269561] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8048a42-faa2-488a-a574-b00127a0261d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.755783] env[70013]: INFO networking_nsxv3.common.synchronization [None req-1216ecfd-35e5-431d-a195-6189fc100742 None None] Enqueued Resource ID: e187f784-2cbd-4151-91ad-048c0ebf44db with Priority: HIGHEST for action port [ 586.756104] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e187f784-2cbd-4151-91ad-048c0ebf44db with Priority: HIGHEST for action port [ 586.756604] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-e187f784-2cbd-4151-91ad-048c0ebf44db taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.756727] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e187f784-2cbd-4151-91ad-048c0ebf44db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.756886] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e187f784-2cbd-4151-91ad-048c0ebf44db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.757187] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e187f784-2cbd-4151-91ad-048c0ebf44db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.757297] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e187f784-2cbd-4151-91ad-048c0ebf44db',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.260251] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e187f784-2cbd-4151-91ad-048c0ebf44db [ 587.261313] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.261313] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.261313] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.261313] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.261313] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.261313] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e187f784-2cbd-4151-91ad-048c0ebf44db already deleted. [ 587.261313] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e187f784-2cbd-4151-91ad-048c0ebf44db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.769765] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.770107] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.770107] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.770206] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.770469] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.096300] env[70013]: INFO networking_nsxv3.common.synchronization [None req-4d97e014-36e5-4585-b921-5d75515a58f9 None None] Enqueued Resource ID: da34582a-68f6-4899-b05c-4f4269a1fc2c with Priority: HIGHEST for action port [ 588.096567] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da34582a-68f6-4899-b05c-4f4269a1fc2c with Priority: HIGHEST for action port [ 588.097137] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-da34582a-68f6-4899-b05c-4f4269a1fc2c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.097265] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da34582a-68f6-4899-b05c-4f4269a1fc2c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.097400] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da34582a-68f6-4899-b05c-4f4269a1fc2c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.097575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da34582a-68f6-4899-b05c-4f4269a1fc2c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.097949] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da34582a-68f6-4899-b05c-4f4269a1fc2c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.134045] env[70013]: INFO networking_nsxv3.common.synchronization [None req-0a5d9892-0045-4eee-836d-5039a2ddeb11 None None] Enqueued Resource ID: 699e2094-b16c-4a6b-8242-9d7ba062c85b with Priority: HIGHEST for action port [ 588.134045] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 699e2094-b16c-4a6b-8242-9d7ba062c85b with Priority: HIGHEST for action port [ 588.134153] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-699e2094-b16c-4a6b-8242-9d7ba062c85b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.134253] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-699e2094-b16c-4a6b-8242-9d7ba062c85b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.134336] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-699e2094-b16c-4a6b-8242-9d7ba062c85b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.134575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-699e2094-b16c-4a6b-8242-9d7ba062c85b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.134643] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('699e2094-b16c-4a6b-8242-9d7ba062c85b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.275760] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.603414] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port da34582a-68f6-4899-b05c-4f4269a1fc2c [ 588.603414] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.603414] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.603617] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.603687] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.603782] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.603882] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:da34582a-68f6-4899-b05c-4f4269a1fc2c already deleted. [ 588.603963] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da34582a-68f6-4899-b05c-4f4269a1fc2c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.639168] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 699e2094-b16c-4a6b-8242-9d7ba062c85b [ 588.639168] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.639168] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.639168] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.639445] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.639445] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.639537] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:699e2094-b16c-4a6b-8242-9d7ba062c85b already deleted. [ 588.640032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-699e2094-b16c-4a6b-8242-9d7ba062c85b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.778671] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.848760] env[70013]: INFO networking_nsxv3.common.synchronization [None req-34f68b69-fa2d-43c6-997a-485a94813e95 None None] Enqueued Resource ID: 78dedf94-99d9-49c6-8f92-415e6b0c061d with Priority: HIGHEST for action port [ 588.848906] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78dedf94-99d9-49c6-8f92-415e6b0c061d with Priority: HIGHEST for action port [ 588.850659] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-78dedf94-99d9-49c6-8f92-415e6b0c061d taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.850659] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78dedf94-99d9-49c6-8f92-415e6b0c061d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.850916] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78dedf94-99d9-49c6-8f92-415e6b0c061d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.854035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78dedf94-99d9-49c6-8f92-415e6b0c061d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.854110] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78dedf94-99d9-49c6-8f92-415e6b0c061d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.946993] env[70013]: INFO networking_nsxv3.common.synchronization [None req-6cd6ebda-8135-4f8c-8514-c33893f76a8a None None] Enqueued Resource ID: 8a4599e8-e6c0-46dd-96c4-49b1f86663fe with Priority: HIGHEST for action port [ 588.947184] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a4599e8-e6c0-46dd-96c4-49b1f86663fe with Priority: HIGHEST for action port [ 588.947839] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a4599e8-e6c0-46dd-96c4-49b1f86663fe taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.947968] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a4599e8-e6c0-46dd-96c4-49b1f86663fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.949382] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a4599e8-e6c0-46dd-96c4-49b1f86663fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.950147] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a4599e8-e6c0-46dd-96c4-49b1f86663fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.950147] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a4599e8-e6c0-46dd-96c4-49b1f86663fe',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.282758] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 589.282873] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 589.357427] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 78dedf94-99d9-49c6-8f92-415e6b0c061d [ 589.357673] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.357931] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.357931] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.358118] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.358213] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.358313] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:78dedf94-99d9-49c6-8f92-415e6b0c061d already deleted. [ 589.358398] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78dedf94-99d9-49c6-8f92-415e6b0c061d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.452150] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8a4599e8-e6c0-46dd-96c4-49b1f86663fe [ 589.452414] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.452560] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.452647] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.452867] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.452961] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.453081] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8a4599e8-e6c0-46dd-96c4-49b1f86663fe already deleted. [ 589.453193] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a4599e8-e6c0-46dd-96c4-49b1f86663fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.985488] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.985488] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.985488] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.985488] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.998242] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 589.999998] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.001214] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 590.019462] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.019657] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.019732] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.019950] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.020050] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.020165] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 590.020235] env[70013]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70013) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 590.020365] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 590.040527] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.040527] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.040527] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.040527] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.041648] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.043891] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 590.062321] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.062455] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.062542] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.062744] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.062855] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.062968] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 590.079893] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.080056] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.080142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.081464] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.081547] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.081663] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 590.081782] env[70013]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=70013) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 590.081907] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 590.099179] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.099343] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.099415] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.099585] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.099862] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.099862] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 590.099862] env[70013]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70013) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 590.099958] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 590.118605] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.118756] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.118816] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.119023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.119955] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.120099] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 590.120193] env[70013]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70013) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 590.120796] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 590.120796] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 590.120796] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 590.120796] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 590.120796] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 590.120796] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 590.121100] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 590.121100] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 590.141947] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.144021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.144021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.144021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.144021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.144021] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 590.162194] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.162989] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.163256] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.163570] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.165167] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.182762] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.630281] env[70013]: INFO networking_nsxv3.common.synchronization [None req-27dcad4a-fd34-4b2f-b45f-4a4fa36d44b0 None None] Enqueued Resource ID: 16006566-1683-446b-8540-f8bd805a9bf1 with Priority: HIGHEST for action port [ 590.630590] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16006566-1683-446b-8540-f8bd805a9bf1 with Priority: HIGHEST for action port [ 590.631178] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-16006566-1683-446b-8540-f8bd805a9bf1 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.631306] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16006566-1683-446b-8540-f8bd805a9bf1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.631403] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16006566-1683-446b-8540-f8bd805a9bf1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.631686] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16006566-1683-446b-8540-f8bd805a9bf1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.631773] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16006566-1683-446b-8540-f8bd805a9bf1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.136907] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 16006566-1683-446b-8540-f8bd805a9bf1 [ 591.137202] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.137340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.137418] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.137639] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.137733] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.137829] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:16006566-1683-446b-8540-f8bd805a9bf1 already deleted. [ 591.137908] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16006566-1683-446b-8540-f8bd805a9bf1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.232432] env[70013]: INFO networking_nsxv3.common.synchronization [None req-77b23213-4013-4c2f-959f-33286f3879fd None None] Enqueued Resource ID: 062689c4-e184-4c19-83e3-52cdfbe469d5 with Priority: HIGHEST for action port [ 591.232688] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 062689c4-e184-4c19-83e3-52cdfbe469d5 with Priority: HIGHEST for action port [ 591.233558] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-062689c4-e184-4c19-83e3-52cdfbe469d5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.233558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-062689c4-e184-4c19-83e3-52cdfbe469d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.233558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-062689c4-e184-4c19-83e3-52cdfbe469d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.233743] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-062689c4-e184-4c19-83e3-52cdfbe469d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.233743] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('062689c4-e184-4c19-83e3-52cdfbe469d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.738008] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 062689c4-e184-4c19-83e3-52cdfbe469d5 [ 591.738008] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.738008] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.738008] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.738008] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.738008] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.738008] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:062689c4-e184-4c19-83e3-52cdfbe469d5 already deleted. [ 591.738008] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-062689c4-e184-4c19-83e3-52cdfbe469d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.009617] env[70013]: INFO networking_nsxv3.common.synchronization [None req-6ece9237-308b-47cf-a660-7813532d4c6b tempest-ServersTestManualDisk-1313496142 tempest-ServersTestManualDisk-1313496142-project-member] Enqueued Resource ID: 73383895-5111-42cc-a071-b2512b2f23af with Priority: HIGHEST for action security_group_rules [ 592.010150] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73383895-5111-42cc-a071-b2512b2f23af with Priority: HIGHEST for action security_group_rules [ 592.010476] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73383895-5111-42cc-a071-b2512b2f23af taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.010606] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.010676] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.011314] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.011314] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73383895-5111-42cc-a071-b2512b2f23af',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.147660] env[70013]: INFO networking_nsxv3.common.synchronization [None req-6fda8a0d-bf42-42b0-9163-32a853a30e16 None None] Enqueued Resource ID: 51d2ce16-beef-490c-9df9-161fd96cf45a with Priority: HIGHEST for action port [ 592.147919] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51d2ce16-beef-490c-9df9-161fd96cf45a with Priority: HIGHEST for action port [ 592.148493] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-51d2ce16-beef-490c-9df9-161fd96cf45a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.148641] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51d2ce16-beef-490c-9df9-161fd96cf45a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.148715] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51d2ce16-beef-490c-9df9-161fd96cf45a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.148956] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51d2ce16-beef-490c-9df9-161fd96cf45a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.153128] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51d2ce16-beef-490c-9df9-161fd96cf45a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.419548] env[70013]: INFO networking_nsxv3.common.synchronization [None req-600b0a1e-fd47-4927-a36e-392165ab663f tempest-ServersTestManualDisk-1313496142 tempest-ServersTestManualDisk-1313496142-project-member] Enqueued Resource ID: 73383895-5111-42cc-a071-b2512b2f23af with Priority: HIGHEST for action security_group_rules [ 592.419548] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73383895-5111-42cc-a071-b2512b2f23af with Priority: HIGHEST for action security_group_rules [ 592.419548] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73383895-5111-42cc-a071-b2512b2f23af taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.419548] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.511709] env[70013]: INFO networking_nsxv3.common.synchronization [None req-20a1f51a-634e-4531-b641-2d6dbc81c7b9 None None] Enqueued Resource ID: 49aa1e35-c27a-4a46-920c-59b945a1849e with Priority: HIGHEST for action port [ 592.511965] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49aa1e35-c27a-4a46-920c-59b945a1849e with Priority: HIGHEST for action port [ 592.512784] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-49aa1e35-c27a-4a46-920c-59b945a1849e taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.512912] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49aa1e35-c27a-4a46-920c-59b945a1849e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.512984] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49aa1e35-c27a-4a46-920c-59b945a1849e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.514940] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49aa1e35-c27a-4a46-920c-59b945a1849e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.515047] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49aa1e35-c27a-4a46-920c-59b945a1849e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.534127] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.534374] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.534374] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.534737] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.534737] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.535374] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73383895-5111-42cc-a071-b2512b2f23af already deleted. [ 592.535374] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.535374] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.535493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.535770] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73383895-5111-42cc-a071-b2512b2f23af',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.656507] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 51d2ce16-beef-490c-9df9-161fd96cf45a [ 592.656741] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.656880] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.656955] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.657901] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.657901] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.657901] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:51d2ce16-beef-490c-9df9-161fd96cf45a already deleted. [ 592.657901] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51d2ce16-beef-490c-9df9-161fd96cf45a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.841797] env[70013]: INFO networking_nsxv3.common.synchronization [None req-21d6682c-d579-46b3-93f3-382194826c28 None None] Enqueued Resource ID: 326c6815-17c7-4195-a46e-52114e8b64ce with Priority: HIGHEST for action port [ 592.842096] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 326c6815-17c7-4195-a46e-52114e8b64ce with Priority: HIGHEST for action port [ 592.843035] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-326c6815-17c7-4195-a46e-52114e8b64ce taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.843035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-326c6815-17c7-4195-a46e-52114e8b64ce" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.843035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-326c6815-17c7-4195-a46e-52114e8b64ce" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.843320] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-326c6815-17c7-4195-a46e-52114e8b64ce" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.843320] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('326c6815-17c7-4195-a46e-52114e8b64ce',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.018212] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 49aa1e35-c27a-4a46-920c-59b945a1849e [ 593.020450] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.020450] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.020450] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.020450] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.020450] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.020450] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:49aa1e35-c27a-4a46-920c-59b945a1849e already deleted. [ 593.020450] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49aa1e35-c27a-4a46-920c-59b945a1849e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.055164] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.055303] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.055373] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.055586] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.055699] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.055762] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73383895-5111-42cc-a071-b2512b2f23af already deleted. [ 593.055877] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.345352] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 326c6815-17c7-4195-a46e-52114e8b64ce [ 593.346056] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.346393] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.346507] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.346750] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.347203] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.347638] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:326c6815-17c7-4195-a46e-52114e8b64ce already deleted. [ 593.347638] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-326c6815-17c7-4195-a46e-52114e8b64ce" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.566371] env[70013]: INFO networking_nsxv3.common.synchronization [req-32eb4ab7-ea59-4f2b-a410-1fc9e00205a5 req-0ce6d189-99d2-4207-aa52-00a6380c37cf tempest-SecurityGroupRulesTestJSON-1067418828 tempest-SecurityGroupRulesTestJSON-1067418828-project-member] Enqueued Resource ID: bd889962-2d2f-402a-8e09-890530814eab with Priority: HIGHEST for action security_group_rules [ 593.566994] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd889962-2d2f-402a-8e09-890530814eab with Priority: HIGHEST for action security_group_rules [ 593.567833] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd889962-2d2f-402a-8e09-890530814eab taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.567959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd889962-2d2f-402a-8e09-890530814eab" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.568541] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd889962-2d2f-402a-8e09-890530814eab" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.568541] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd889962-2d2f-402a-8e09-890530814eab" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.568541] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd889962-2d2f-402a-8e09-890530814eab',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.090069] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.090069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.090069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.090069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.090069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.090069] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd889962-2d2f-402a-8e09-890530814eab already deleted. [ 594.090069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd889962-2d2f-402a-8e09-890530814eab" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.468919] env[70013]: INFO networking_nsxv3.common.synchronization [None req-b21ca026-89fe-4e5e-8df7-42a4e538336a tempest-VolumesAdminNegativeTest-973826376 tempest-VolumesAdminNegativeTest-973826376-project-member] Enqueued Resource ID: aa7b798e-2025-4d46-88f3-8e44eeb87989 with Priority: HIGHEST for action security_group_rules [ 594.469339] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7b798e-2025-4d46-88f3-8e44eeb87989 with Priority: HIGHEST for action security_group_rules [ 594.469816] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa7b798e-2025-4d46-88f3-8e44eeb87989 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.469912] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.469954] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.472960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.473070] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa7b798e-2025-4d46-88f3-8e44eeb87989',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.654408] env[70013]: INFO networking_nsxv3.common.synchronization [None req-84e57fdc-2bfe-46b4-b2fe-ae2a6c6f3a2b tempest-VolumesAdminNegativeTest-973826376 tempest-VolumesAdminNegativeTest-973826376-project-member] Enqueued Resource ID: aa7b798e-2025-4d46-88f3-8e44eeb87989 with Priority: HIGHEST for action security_group_rules [ 594.654895] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7b798e-2025-4d46-88f3-8e44eeb87989 with Priority: HIGHEST for action security_group_rules [ 594.655228] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa7b798e-2025-4d46-88f3-8e44eeb87989 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.655318] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.994993] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.995364] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.995439] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.995753] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.995753] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.996108] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa7b798e-2025-4d46-88f3-8e44eeb87989 already deleted. [ 594.996108] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.997567] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.997567] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.997567] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa7b798e-2025-4d46-88f3-8e44eeb87989',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.088237] env[70013]: INFO networking_nsxv3.common.synchronization [None req-b65d6aac-163a-4551-865f-ad5c739d0000 None None] Enqueued Resource ID: a0c3767c-c905-4229-9245-3bfbf59a87cb with Priority: HIGHEST for action port [ 595.088820] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0c3767c-c905-4229-9245-3bfbf59a87cb with Priority: HIGHEST for action port [ 595.089134] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0c3767c-c905-4229-9245-3bfbf59a87cb taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.089527] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0c3767c-c905-4229-9245-3bfbf59a87cb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.089527] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0c3767c-c905-4229-9245-3bfbf59a87cb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.089684] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0c3767c-c905-4229-9245-3bfbf59a87cb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.089684] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0c3767c-c905-4229-9245-3bfbf59a87cb',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.319149] env[70013]: INFO networking_nsxv3.common.synchronization [None req-51b53853-ffb2-4942-97d1-4feca00873ee None None] Enqueued Resource ID: 754e64b5-fab0-439c-b0d2-006b3a1518a0 with Priority: HIGHEST for action port [ 595.320114] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 754e64b5-fab0-439c-b0d2-006b3a1518a0 with Priority: HIGHEST for action port [ 595.320114] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-754e64b5-fab0-439c-b0d2-006b3a1518a0 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.320114] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-754e64b5-fab0-439c-b0d2-006b3a1518a0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.320292] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-754e64b5-fab0-439c-b0d2-006b3a1518a0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.320399] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-754e64b5-fab0-439c-b0d2-006b3a1518a0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.320642] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('754e64b5-fab0-439c-b0d2-006b3a1518a0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.518792] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.518792] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.518792] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.518792] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.518792] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.518792] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa7b798e-2025-4d46-88f3-8e44eeb87989 already deleted. [ 595.518792] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.594133] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a0c3767c-c905-4229-9245-3bfbf59a87cb [ 595.594296] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.594296] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.594412] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.594610] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.594741] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.594839] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a0c3767c-c905-4229-9245-3bfbf59a87cb already deleted. [ 595.594881] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0c3767c-c905-4229-9245-3bfbf59a87cb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.822412] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 754e64b5-fab0-439c-b0d2-006b3a1518a0 [ 595.823575] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.823575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.823575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.823575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.823575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.823575] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:754e64b5-fab0-439c-b0d2-006b3a1518a0 already deleted. [ 595.823575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-754e64b5-fab0-439c-b0d2-006b3a1518a0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.391955] env[70013]: INFO networking_nsxv3.common.synchronization [req-5571eb28-687c-46fb-954a-f6a91c63faea req-20820684-0977-4a6c-9f8a-2a8b574bc0f4 tempest-ServerDiagnosticsNegativeTest-1667465715 tempest-ServerDiagnosticsNegativeTest-1667465715-project-member] Enqueued Resource ID: 9546ef83-051f-4623-9fa9-0c95fc065e91 with Priority: HIGHEST for action security_group_members [ 596.391955] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9546ef83-051f-4623-9fa9-0c95fc065e91 with Priority: HIGHEST for action security_group_members [ 596.393197] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9546ef83-051f-4623-9fa9-0c95fc065e91 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.393197] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.393197] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.393197] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.393197] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.393197] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.393197] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.393197] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.393197] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.393638] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9546ef83-051f-4623-9fa9-0c95fc065e91',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.776208] env[70013]: INFO networking_nsxv3.common.synchronization [None req-13389b65-6f57-4c2a-ba8b-a251415684d8 None None] Enqueued Resource ID: f176be55-6614-4708-9144-4440b753f328 with Priority: HIGHEST for action port [ 596.776786] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f176be55-6614-4708-9144-4440b753f328 with Priority: HIGHEST for action port [ 596.777100] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-f176be55-6614-4708-9144-4440b753f328 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.777269] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f176be55-6614-4708-9144-4440b753f328" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.777321] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f176be55-6614-4708-9144-4440b753f328" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.777824] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f176be55-6614-4708-9144-4440b753f328" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.777824] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f176be55-6614-4708-9144-4440b753f328',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.865990] env[70013]: INFO networking_nsxv3.common.synchronization [req-d53cc4e0-9dd0-4787-a57c-ae5078df6167 req-1bae0fe6-ba82-414f-a855-775e4971c03b tempest-SecurityGroupRulesTestJSON-1067418828 tempest-SecurityGroupRulesTestJSON-1067418828-project-member] Enqueued Resource ID: 670649d6-d2c8-43f2-b67c-d78479ae6ef8 with Priority: HIGHEST for action security_group_rules [ 596.866597] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 670649d6-d2c8-43f2-b67c-d78479ae6ef8 with Priority: HIGHEST for action security_group_rules [ 596.867040] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-670649d6-d2c8-43f2-b67c-d78479ae6ef8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.867127] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-670649d6-d2c8-43f2-b67c-d78479ae6ef8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.867702] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-670649d6-d2c8-43f2-b67c-d78479ae6ef8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.867702] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-670649d6-d2c8-43f2-b67c-d78479ae6ef8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.867702] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('670649d6-d2c8-43f2-b67c-d78479ae6ef8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.897036] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.897036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.897036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.897036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.897036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.897036] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.897036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.897036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.897409] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.897409] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.897409] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9546ef83-051f-4623-9fa9-0c95fc065e91 already deleted. [ 596.897409] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.280419] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f176be55-6614-4708-9144-4440b753f328 [ 597.282016] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.282132] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.282192] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.282363] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.282639] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.282639] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f176be55-6614-4708-9144-4440b753f328 already deleted. [ 597.282639] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f176be55-6614-4708-9144-4440b753f328" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.387621] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.387745] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.387820] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.388037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.388130] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.388305] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 670649d6-d2c8-43f2-b67c-d78479ae6ef8 already deleted. [ 597.388378] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-670649d6-d2c8-43f2-b67c-d78479ae6ef8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.640487] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-701 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.640487] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.640487] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.640487] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.641456] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.642076] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.642402] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.643440] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.643978] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.644556] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 597.644970] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 597.646088] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 597.646088] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 597.646088] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 597.646088] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 597.646088] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 597.662910] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 597.663095] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 597.663312] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 597.663412] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.663730] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-eb757fe7-6cda-466e-9979-29e56b057f1c taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.663939] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-eb757fe7-6cda-466e-9979-29e56b057f1c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.664167] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-eb757fe7-6cda-466e-9979-29e56b057f1c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.664396] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-eb757fe7-6cda-466e-9979-29e56b057f1c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.664469] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb757fe7-6cda-466e-9979-29e56b057f1c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.996376] env[70013]: INFO networking_nsxv3.common.synchronization [None req-3a5a078d-2051-43e6-9a90-4e2ffbbca50d None None] Enqueued Resource ID: e3f463be-c69c-49cd-8d94-fa2d4f678638 with Priority: HIGHEST for action port [ 597.996916] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3f463be-c69c-49cd-8d94-fa2d4f678638 with Priority: HIGHEST for action port [ 597.997960] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3f463be-c69c-49cd-8d94-fa2d4f678638 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.997960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3f463be-c69c-49cd-8d94-fa2d4f678638" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.997960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3f463be-c69c-49cd-8d94-fa2d4f678638" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.997960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3f463be-c69c-49cd-8d94-fa2d4f678638" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.997960] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3f463be-c69c-49cd-8d94-fa2d4f678638',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.167373] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.169609] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.169609] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.169609] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.169609] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.169609] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port eb757fe7-6cda-466e-9979-29e56b057f1c not found, creating... [ 598.169609] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.169609] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.169924] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.169973] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.170134] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.170550] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.170717] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.170839] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.171077] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.171217] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.171412] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: eb757fe7-6cda-466e-9979-29e56b057f1c is going to be created. [ 598.199480] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.201016] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.201016] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.201016] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.201016] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.201492] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-eb757fe7-6cda-466e-9979-29e56b057f1c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.503663] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e3f463be-c69c-49cd-8d94-fa2d4f678638 [ 598.503663] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.503663] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.503663] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.503663] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.503663] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.503663] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e3f463be-c69c-49cd-8d94-fa2d4f678638 already deleted. [ 598.503663] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3f463be-c69c-49cd-8d94-fa2d4f678638" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.522131] env[70013]: INFO networking_nsxv3.common.synchronization [None req-b04fa9df-6c0f-4e86-8007-45064c6a9d76 None None] Enqueued Resource ID: e9c497df-8b9b-446c-bbaa-063aea46383b with Priority: HIGHEST for action port [ 598.522794] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c497df-8b9b-446c-bbaa-063aea46383b with Priority: HIGHEST for action port [ 598.523415] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9c497df-8b9b-446c-bbaa-063aea46383b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.523512] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9c497df-8b9b-446c-bbaa-063aea46383b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.523643] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9c497df-8b9b-446c-bbaa-063aea46383b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.525324] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9c497df-8b9b-446c-bbaa-063aea46383b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.525324] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9c497df-8b9b-446c-bbaa-063aea46383b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.027800] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e9c497df-8b9b-446c-bbaa-063aea46383b [ 599.028162] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.028265] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.028313] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.029704] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.029704] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.029704] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e9c497df-8b9b-446c-bbaa-063aea46383b already deleted. [ 599.029704] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9c497df-8b9b-446c-bbaa-063aea46383b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.312228] env[70013]: INFO networking_nsxv3.common.synchronization [None req-5b11487b-70c7-45c6-9a4a-fa983e993aa2 None None] Enqueued Resource ID: 9c84982f-0d7a-421c-8939-bdff5f9c68d3 with Priority: HIGHEST for action port [ 599.312228] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c84982f-0d7a-421c-8939-bdff5f9c68d3 with Priority: HIGHEST for action port [ 599.312228] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c84982f-0d7a-421c-8939-bdff5f9c68d3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.312228] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c84982f-0d7a-421c-8939-bdff5f9c68d3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.312228] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c84982f-0d7a-421c-8939-bdff5f9c68d3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.312881] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c84982f-0d7a-421c-8939-bdff5f9c68d3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.312988] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c84982f-0d7a-421c-8939-bdff5f9c68d3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.817388] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c84982f-0d7a-421c-8939-bdff5f9c68d3 [ 599.817714] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.817893] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.817993] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.818319] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.818445] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.818578] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c84982f-0d7a-421c-8939-bdff5f9c68d3 already deleted. [ 599.818688] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c84982f-0d7a-421c-8939-bdff5f9c68d3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.927126] env[70013]: INFO networking_nsxv3.common.synchronization [None req-a26b76d9-207f-4d87-86f0-7426f14b946e None None] Enqueued Resource ID: f3bb39ae-76ac-4adf-ab17-b78765059236 with Priority: HIGHEST for action port [ 599.927389] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3bb39ae-76ac-4adf-ab17-b78765059236 with Priority: HIGHEST for action port [ 599.927949] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3bb39ae-76ac-4adf-ab17-b78765059236 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.928075] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3bb39ae-76ac-4adf-ab17-b78765059236" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.928172] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3bb39ae-76ac-4adf-ab17-b78765059236" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.928442] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3bb39ae-76ac-4adf-ab17-b78765059236" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.928524] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3bb39ae-76ac-4adf-ab17-b78765059236',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.213624] env[70013]: INFO networking_nsxv3.common.synchronization [None req-d109e279-3b9a-43ff-8874-bc00cc674657 tempest-VolumesAssistedSnapshotsTest-996933272 tempest-VolumesAssistedSnapshotsTest-996933272-project-member] Enqueued Resource ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd with Priority: HIGHEST for action security_group_rules [ 600.217569] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd with Priority: HIGHEST for action security_group_rules [ 600.217569] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.217569] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.217569] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.217569] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.217569] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.372992] env[70013]: INFO networking_nsxv3.common.synchronization [req-5571eb28-687c-46fb-954a-f6a91c63faea req-885c2eb7-1814-40d8-9732-12c0a472c1e1 service nova] Enqueued Resource ID: 9546ef83-051f-4623-9fa9-0c95fc065e91 with Priority: HIGHEST for action security_group_rules [ 600.376656] env[70013]: INFO networking_nsxv3.common.synchronization [req-5571eb28-687c-46fb-954a-f6a91c63faea req-885c2eb7-1814-40d8-9732-12c0a472c1e1 service nova] Enqueued Resource ID: 9546ef83-051f-4623-9fa9-0c95fc065e91 with Priority: HIGHEST for action security_group_members [ 600.376656] env[70013]: INFO networking_nsxv3.common.synchronization [req-5571eb28-687c-46fb-954a-f6a91c63faea req-885c2eb7-1814-40d8-9732-12c0a472c1e1 service nova] Enqueued Resource ID: eb757fe7-6cda-466e-9979-29e56b057f1c with Priority: HIGHEST for action port [ 600.376656] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9546ef83-051f-4623-9fa9-0c95fc065e91 with Priority: HIGHEST for action security_group_rules [ 600.376656] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9546ef83-051f-4623-9fa9-0c95fc065e91 with Priority: HIGHEST for action security_group_members [ 600.376656] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb757fe7-6cda-466e-9979-29e56b057f1c with Priority: HIGHEST for action port [ 600.376656] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9546ef83-051f-4623-9fa9-0c95fc065e91 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.376656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.376656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.376656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.376656] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9546ef83-051f-4623-9fa9-0c95fc065e91',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.377382] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9546ef83-051f-4623-9fa9-0c95fc065e91 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.377382] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.377382] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.377562] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.378454] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.378612] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.378700] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.380048] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.380187] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.380948] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9546ef83-051f-4623-9fa9-0c95fc065e91',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.383110] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb757fe7-6cda-466e-9979-29e56b057f1c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.383110] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb757fe7-6cda-466e-9979-29e56b057f1c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.383110] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb757fe7-6cda-466e-9979-29e56b057f1c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.383718] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb757fe7-6cda-466e-9979-29e56b057f1c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.385436] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb757fe7-6cda-466e-9979-29e56b057f1c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.431734] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f3bb39ae-76ac-4adf-ab17-b78765059236 [ 600.431734] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.431734] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.431734] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.431734] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.431734] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.432572] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f3bb39ae-76ac-4adf-ab17-b78765059236 already deleted. [ 600.432572] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3bb39ae-76ac-4adf-ab17-b78765059236" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.486715] env[70013]: INFO networking_nsxv3.common.synchronization [None req-e9ec0351-6571-4d44-a555-69ed32596617 tempest-VolumesAssistedSnapshotsTest-996933272 tempest-VolumesAssistedSnapshotsTest-996933272-project-member] Enqueued Resource ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd with Priority: HIGHEST for action security_group_rules [ 600.487834] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd with Priority: HIGHEST for action security_group_rules [ 600.488164] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.489672] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.740226] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.740386] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.740386] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.740594] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.740682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.740815] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd already deleted. [ 600.740891] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.741042] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.741299] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.741299] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.888599] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9546ef83-051f-4623-9fa9-0c95fc065e91 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.888599] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.899778] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eb757fe7-6cda-466e-9979-29e56b057f1c with status ACTIVE [ 600.900099] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.900312] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.900414] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.900720] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.900837] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.901331] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.901331] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.901331] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.901512] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.901560] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.901799] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.901936] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.902065] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.902556] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.902556] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.902556] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eb757fe7-6cda-466e-9979-29e56b057f1c is going to be updated. [ 600.906274] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9546ef83-051f-4623-9fa9-0c95fc065e91',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.926763] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.926763] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.926763] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.926763] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.927852] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.927852] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb757fe7-6cda-466e-9979-29e56b057f1c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.102852] env[70013]: INFO networking_nsxv3.common.synchronization [req-899acf86-2441-4e54-b11c-42492d548d8d req-08223929-b9fe-47eb-9902-0a7e33c1802b tempest-ImagesTestJSON-851757871 tempest-ImagesTestJSON-851757871-project-member] Enqueued Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 601.105185] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 601.106126] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.106126] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.106126] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.106126] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.106126] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.106360] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.106360] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.106424] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.106456] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.106547] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.257506] env[70013]: INFO networking_nsxv3.common.synchronization [req-b7234ac2-2bdf-4513-881e-424a4e7b4db5 req-1010a68c-cc5a-42bd-9ed8-ad0f53aafcb0 tempest-SecurityGroupRulesTestJSON-1067418828 tempest-SecurityGroupRulesTestJSON-1067418828-project-member] Enqueued Resource ID: af85128e-7029-4d73-8ad9-4de85ec16e0e with Priority: HIGHEST for action security_group_rules [ 601.258101] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af85128e-7029-4d73-8ad9-4de85ec16e0e with Priority: HIGHEST for action security_group_rules [ 601.258440] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af85128e-7029-4d73-8ad9-4de85ec16e0e taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.258552] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af85128e-7029-4d73-8ad9-4de85ec16e0e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.258619] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af85128e-7029-4d73-8ad9-4de85ec16e0e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.258860] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af85128e-7029-4d73-8ad9-4de85ec16e0e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.258944] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af85128e-7029-4d73-8ad9-4de85ec16e0e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.261897] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.261897] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.261897] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.262173] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.262173] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.262288] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd already deleted. [ 601.262340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.408791] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9546ef83-051f-4623-9fa9-0c95fc065e91',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.611325] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.611325] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.611325] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.611325] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.611325] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.611325] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.611325] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.611325] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.611325] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.611325] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.611325] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 already deleted. [ 601.611325] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.782187] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.782187] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.782187] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.782187] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.782187] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.782187] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af85128e-7029-4d73-8ad9-4de85ec16e0e already deleted. [ 601.782187] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af85128e-7029-4d73-8ad9-4de85ec16e0e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.913706] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.914289] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.915141] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.915562] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.915943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.916355] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9546ef83-051f-4623-9fa9-0c95fc065e91 is going to be created. [ 601.945808] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.945808] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.945808] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.945808] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.945808] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.953297] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9546ef83-051f-4623-9fa9-0c95fc065e91 in Status: UNINITIALIZED for 2s [ 602.297612] env[70013]: INFO networking_nsxv3.common.synchronization [None req-b0e77b51-1989-449e-8fbb-6179ebf3f206 None None] Enqueued Resource ID: 78e44d73-b2dd-4624-ba62-80f63a852f91 with Priority: HIGHEST for action port [ 602.298230] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78e44d73-b2dd-4624-ba62-80f63a852f91 with Priority: HIGHEST for action port [ 602.300691] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-78e44d73-b2dd-4624-ba62-80f63a852f91 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.300691] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78e44d73-b2dd-4624-ba62-80f63a852f91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.300691] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78e44d73-b2dd-4624-ba62-80f63a852f91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.300691] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78e44d73-b2dd-4624-ba62-80f63a852f91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.300691] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78e44d73-b2dd-4624-ba62-80f63a852f91',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.536508] env[70013]: INFO networking_nsxv3.common.synchronization [req-5390227a-79e2-41ca-8a7c-d15c6cd62c86 req-494bfc6e-4625-432b-a9ea-b8f49bf8c0f1 tempest-DeleteServersAdminTestJSON-1322678731 tempest-DeleteServersAdminTestJSON-1322678731-project-member] Enqueued Resource ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 with Priority: HIGHEST for action security_group_members [ 602.537093] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 with Priority: HIGHEST for action security_group_members [ 602.540101] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16fadac6-f5a2-4997-b67b-221b3b4e45a8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.540101] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.540101] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.540101] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.540101] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.540101] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.540101] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.540101] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.540101] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.540101] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16fadac6-f5a2-4997-b67b-221b3b4e45a8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.801672] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 78e44d73-b2dd-4624-ba62-80f63a852f91 [ 602.803647] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.803647] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.803647] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.803647] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.803647] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.803647] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:78e44d73-b2dd-4624-ba62-80f63a852f91 already deleted. [ 602.803647] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78e44d73-b2dd-4624-ba62-80f63a852f91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.976263] env[70013]: INFO networking_nsxv3.common.synchronization [None req-c0eb6844-f49c-4652-8188-e53566b7dac0 None None] Enqueued Resource ID: b664b0bd-34b0-4836-8a28-99820cd5d740 with Priority: HIGHEST for action port [ 602.976263] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b664b0bd-34b0-4836-8a28-99820cd5d740 with Priority: HIGHEST for action port [ 602.976263] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-b664b0bd-34b0-4836-8a28-99820cd5d740 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.976263] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b664b0bd-34b0-4836-8a28-99820cd5d740" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.976773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b664b0bd-34b0-4836-8a28-99820cd5d740" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.977184] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b664b0bd-34b0-4836-8a28-99820cd5d740" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.977570] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b664b0bd-34b0-4836-8a28-99820cd5d740',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.041749] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.042852] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.042852] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.042852] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.042852] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.042852] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.042852] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.043146] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.043146] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.043146] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.043263] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 already deleted. [ 603.043373] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.164906] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-875 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.165119] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-875" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.165265] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-875" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.165627] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-875" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.165955] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.166299] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.166477] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.168129] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.168129] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.168129] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 603.168129] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 603.168129] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 603.168129] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 603.168129] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 603.168557] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 603.168557] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 603.188618] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 603.188618] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 603.188618] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 603.188618] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-875" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.188817] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-9ead2454-433c-40e4-962b-8e43443376bb taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.188817] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-9ead2454-433c-40e4-962b-8e43443376bb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.188910] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-9ead2454-433c-40e4-962b-8e43443376bb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.189432] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-9ead2454-433c-40e4-962b-8e43443376bb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.189432] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ead2454-433c-40e4-962b-8e43443376bb',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.480858] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b664b0bd-34b0-4836-8a28-99820cd5d740 [ 603.481511] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.482322] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.482478] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.483577] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.484468] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.484668] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b664b0bd-34b0-4836-8a28-99820cd5d740 already deleted. [ 603.484843] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b664b0bd-34b0-4836-8a28-99820cd5d740" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.624182] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-701 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.624182] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.624182] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.624182] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.624182] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.624182] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.624182] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.624182] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.624182] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.624182] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 603.624182] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 603.626184] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 603.626607] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 603.626861] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 603.627100] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 603.627327] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 603.648333] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 603.651019] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 603.651019] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 603.651019] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.651019] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-154faccc-5d99-43cc-a66e-9c06bcc5fdf2 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.651019] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-154faccc-5d99-43cc-a66e-9c06bcc5fdf2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.651019] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-154faccc-5d99-43cc-a66e-9c06bcc5fdf2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.651019] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-154faccc-5d99-43cc-a66e-9c06bcc5fdf2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.651019] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('154faccc-5d99-43cc-a66e-9c06bcc5fdf2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.694322] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.694322] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.694322] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.694322] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.694322] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.694322] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 9ead2454-433c-40e4-962b-8e43443376bb not found, creating... [ 603.694322] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.694322] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.694322] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.694322] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.694713] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.694960] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.695172] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.699678] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.699678] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.699678] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.699678] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 9ead2454-433c-40e4-962b-8e43443376bb is going to be created. [ 603.721746] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.721746] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.721746] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.721746] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.721746] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.721746] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-9ead2454-433c-40e4-962b-8e43443376bb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.966156] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9546ef83-051f-4623-9fa9-0c95fc065e91 in Status: SUCCESS [ 603.966156] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.966156] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.966156] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.966156] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.966156] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.966156] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.966156] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.966156] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.966156] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.966667] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9546ef83-051f-4623-9fa9-0c95fc065e91',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.155995] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.156251] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.156372] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.156784] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.156784] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.157377] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 154faccc-5d99-43cc-a66e-9c06bcc5fdf2 not found, creating... [ 604.157377] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.157844] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.158035] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.158302] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.158413] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.158716] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.158870] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.159028] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.159257] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.159440] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.160332] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 154faccc-5d99-43cc-a66e-9c06bcc5fdf2 is going to be created. [ 604.182486] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.182685] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.182816] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.183106] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.183355] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.183578] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-154faccc-5d99-43cc-a66e-9c06bcc5fdf2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.286922] env[70013]: INFO networking_nsxv3.common.synchronization [None req-875b852a-be39-4f3f-8289-4cf55e063f50 None None] Enqueued Resource ID: 62456103-468c-4d3c-ba78-d4da8707cd93 with Priority: HIGHEST for action port [ 604.287350] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62456103-468c-4d3c-ba78-d4da8707cd93 with Priority: HIGHEST for action port [ 604.287775] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-62456103-468c-4d3c-ba78-d4da8707cd93 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.287899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62456103-468c-4d3c-ba78-d4da8707cd93" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.287965] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62456103-468c-4d3c-ba78-d4da8707cd93" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.289059] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62456103-468c-4d3c-ba78-d4da8707cd93" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.289168] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62456103-468c-4d3c-ba78-d4da8707cd93',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.303628] env[70013]: INFO networking_nsxv3.common.synchronization [None req-bf2a8345-99fc-49ad-9222-cc7d275e1b19 None None] Enqueued Resource ID: a5baf7c5-449d-44c7-af6d-e90d0e26c579 with Priority: HIGHEST for action port [ 604.303786] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5baf7c5-449d-44c7-af6d-e90d0e26c579 with Priority: HIGHEST for action port [ 604.304516] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5baf7c5-449d-44c7-af6d-e90d0e26c579 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.304660] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5baf7c5-449d-44c7-af6d-e90d0e26c579" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.304660] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5baf7c5-449d-44c7-af6d-e90d0e26c579" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.306157] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5baf7c5-449d-44c7-af6d-e90d0e26c579" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.306784] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5baf7c5-449d-44c7-af6d-e90d0e26c579',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.468958] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9546ef83-051f-4623-9fa9-0c95fc065e91 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.469137] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.469207] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.469428] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.473021] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.473021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.473021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.473021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.473021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.473021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.473021] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9546ef83-051f-4623-9fa9-0c95fc065e91 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.473021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.473021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.473021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.473021] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.473021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.473021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.473021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.473021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.473021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.473021] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9546ef83-051f-4623-9fa9-0c95fc065e91',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.791153] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 62456103-468c-4d3c-ba78-d4da8707cd93 [ 604.791153] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.793672] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.793672] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.793672] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.793672] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.793672] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:62456103-468c-4d3c-ba78-d4da8707cd93 already deleted. [ 604.793672] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62456103-468c-4d3c-ba78-d4da8707cd93" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.809032] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a5baf7c5-449d-44c7-af6d-e90d0e26c579 [ 604.809032] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.809165] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.809208] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.809994] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.809994] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.809994] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a5baf7c5-449d-44c7-af6d-e90d0e26c579 already deleted. [ 604.809994] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5baf7c5-449d-44c7-af6d-e90d0e26c579" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.863993] env[70013]: INFO networking_nsxv3.common.synchronization [req-59106c2f-8193-40dc-920f-59571ab8a6e8 req-c5ad5532-2b6a-458e-bf60-264657fbeffa tempest-ServersTestManualDisk-1313496142 tempest-ServersTestManualDisk-1313496142-project-member] Enqueued Resource ID: 73383895-5111-42cc-a071-b2512b2f23af with Priority: HIGHEST for action security_group_members [ 604.864607] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73383895-5111-42cc-a071-b2512b2f23af with Priority: HIGHEST for action security_group_members [ 604.865267] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-73383895-5111-42cc-a071-b2512b2f23af taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.865438] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.865492] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.865733] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.865895] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.866023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.866067] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.866226] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.866319] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.866401] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73383895-5111-42cc-a071-b2512b2f23af',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.973840] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9546ef83-051f-4623-9fa9-0c95fc065e91: rpc.has_security_group_logging(os_id): False [ 604.992606] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.995022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.995022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.995022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.995022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.995022] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.995022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.995022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.995022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.995022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.995022] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.995022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.995022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.995022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.995022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.995573] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.995573] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.995573] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.995573] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.995573] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.995914] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9546ef83-051f-4623-9fa9-0c95fc065e91 is going to be created. [ 605.056730] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.057161] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.057257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.057492] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.057677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.071241] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9546ef83-051f-4623-9fa9-0c95fc065e91 in Status: IN_PROGRESS for 2s [ 605.270198] env[70013]: INFO networking_nsxv3.common.synchronization [None req-ed53fcb6-3145-40fa-8967-e81d32c9b3ca None None] Enqueued Resource ID: d8f5c7b7-2099-4838-a852-2159e71c0826 with Priority: HIGHEST for action port [ 605.270390] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8f5c7b7-2099-4838-a852-2159e71c0826 with Priority: HIGHEST for action port [ 605.270954] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8f5c7b7-2099-4838-a852-2159e71c0826 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.272756] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8f5c7b7-2099-4838-a852-2159e71c0826" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.272756] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8f5c7b7-2099-4838-a852-2159e71c0826" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.272756] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8f5c7b7-2099-4838-a852-2159e71c0826" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.272756] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8f5c7b7-2099-4838-a852-2159e71c0826',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.370348] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.370348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.370348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.370348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.370348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.370348] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.370348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.370348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.370348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.370348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.370348] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73383895-5111-42cc-a071-b2512b2f23af already deleted. [ 605.370348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.776640] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d8f5c7b7-2099-4838-a852-2159e71c0826 [ 605.776880] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.776973] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.776973] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.777212] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.777307] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.777394] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d8f5c7b7-2099-4838-a852-2159e71c0826 already deleted. [ 605.777478] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8f5c7b7-2099-4838-a852-2159e71c0826" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.877413] env[70013]: INFO networking_nsxv3.common.synchronization [None req-1013fd3f-cdc3-40ee-bdbd-43b7180cbf9f None None] Enqueued Resource ID: 26e481e0-0171-49bd-9973-2e5b94020cd2 with Priority: HIGHEST for action port [ 605.877747] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26e481e0-0171-49bd-9973-2e5b94020cd2 with Priority: HIGHEST for action port [ 605.878722] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-26e481e0-0171-49bd-9973-2e5b94020cd2 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.878722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26e481e0-0171-49bd-9973-2e5b94020cd2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.878722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26e481e0-0171-49bd-9973-2e5b94020cd2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.878840] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26e481e0-0171-49bd-9973-2e5b94020cd2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.878840] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26e481e0-0171-49bd-9973-2e5b94020cd2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.181254] env[70013]: INFO networking_nsxv3.common.synchronization [req-5390227a-79e2-41ca-8a7c-d15c6cd62c86 req-5f3334b5-a2a9-48a6-b7f2-427830ea02a1 service nova] Enqueued Resource ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 with Priority: HIGHEST for action security_group_rules [ 606.181254] env[70013]: INFO networking_nsxv3.common.synchronization [req-5390227a-79e2-41ca-8a7c-d15c6cd62c86 req-5f3334b5-a2a9-48a6-b7f2-427830ea02a1 service nova] Enqueued Resource ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 with Priority: HIGHEST for action security_group_members [ 606.181254] env[70013]: INFO networking_nsxv3.common.synchronization [req-5390227a-79e2-41ca-8a7c-d15c6cd62c86 req-5f3334b5-a2a9-48a6-b7f2-427830ea02a1 service nova] Enqueued Resource ID: 154faccc-5d99-43cc-a66e-9c06bcc5fdf2 with Priority: HIGHEST for action port [ 606.181254] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 with Priority: HIGHEST for action security_group_rules [ 606.181254] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 with Priority: HIGHEST for action security_group_members [ 606.181254] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 154faccc-5d99-43cc-a66e-9c06bcc5fdf2 with Priority: HIGHEST for action port [ 606.182069] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16fadac6-f5a2-4997-b67b-221b3b4e45a8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.182212] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.182279] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.182532] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.182629] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16fadac6-f5a2-4997-b67b-221b3b4e45a8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.183768] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16fadac6-f5a2-4997-b67b-221b3b4e45a8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.184010] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.184010] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.184137] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.184293] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.184387] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.185039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.185039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.185039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.185039] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16fadac6-f5a2-4997-b67b-221b3b4e45a8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.187125] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-154faccc-5d99-43cc-a66e-9c06bcc5fdf2 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.187245] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-154faccc-5d99-43cc-a66e-9c06bcc5fdf2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.187326] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-154faccc-5d99-43cc-a66e-9c06bcc5fdf2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.190812] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-154faccc-5d99-43cc-a66e-9c06bcc5fdf2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.190812] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('154faccc-5d99-43cc-a66e-9c06bcc5fdf2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.382663] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26e481e0-0171-49bd-9973-2e5b94020cd2 [ 606.382926] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.383189] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.383189] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.383588] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.383588] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.383588] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26e481e0-0171-49bd-9973-2e5b94020cd2 already deleted. [ 606.383738] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26e481e0-0171-49bd-9973-2e5b94020cd2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.394315] env[70013]: INFO networking_nsxv3.common.synchronization [req-899acf86-2441-4e54-b11c-42492d548d8d req-f671a996-512e-4550-830e-b0a43238461e service nova] Enqueued Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_rules [ 606.394315] env[70013]: INFO networking_nsxv3.common.synchronization [req-899acf86-2441-4e54-b11c-42492d548d8d req-f671a996-512e-4550-830e-b0a43238461e service nova] Enqueued Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 606.394315] env[70013]: INFO networking_nsxv3.common.synchronization [req-899acf86-2441-4e54-b11c-42492d548d8d req-f671a996-512e-4550-830e-b0a43238461e service nova] Enqueued Resource ID: 9ead2454-433c-40e4-962b-8e43443376bb with Priority: HIGHEST for action port [ 606.394315] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_rules [ 606.394315] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 606.394315] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ead2454-433c-40e4-962b-8e43443376bb with Priority: HIGHEST for action port [ 606.394315] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.394315] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.394315] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.394315] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.394896] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.396306] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.396306] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.396306] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.396306] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.396306] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.396306] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.396306] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.396306] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.396306] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.396306] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.399434] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ead2454-433c-40e4-962b-8e43443376bb taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.399434] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ead2454-433c-40e4-962b-8e43443376bb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.399434] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ead2454-433c-40e4-962b-8e43443376bb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.399628] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ead2454-433c-40e4-962b-8e43443376bb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.400253] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ead2454-433c-40e4-962b-8e43443376bb',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.587362] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-114 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.587501] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-114" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.587558] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-114" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.588990] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-114" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.588990] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.588990] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.588990] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.589287] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.589342] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.590200] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 606.590650] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 606.591376] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 606.592487] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 606.592822] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 606.596064] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 606.596064] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 606.617142] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 606.617142] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 606.617142] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 606.617142] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-114" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.617142] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-c7c80204-b8b4-46c6-8d93-38d4879119d3 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.617142] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-c7c80204-b8b4-46c6-8d93-38d4879119d3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.617142] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-c7c80204-b8b4-46c6-8d93-38d4879119d3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.617142] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-c7c80204-b8b4-46c6-8d93-38d4879119d3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.617142] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7c80204-b8b4-46c6-8d93-38d4879119d3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.689842] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16fadac6-f5a2-4997-b67b-221b3b4e45a8 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.689842] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.691025] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16fadac6-f5a2-4997-b67b-221b3b4e45a8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.692591] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 154faccc-5d99-43cc-a66e-9c06bcc5fdf2 with status ACTIVE [ 606.692591] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.692591] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.692591] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.694329] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.694329] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.695471] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.696292] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.696292] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.696292] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.696292] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.696489] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.696489] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.696565] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.696726] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.696726] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.696801] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 154faccc-5d99-43cc-a66e-9c06bcc5fdf2 is going to be updated. [ 606.719649] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.722547] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.722547] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.722547] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.722547] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.722547] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-154faccc-5d99-43cc-a66e-9c06bcc5fdf2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.902237] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.902915] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.907190] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ead2454-433c-40e4-962b-8e43443376bb with status ACTIVE [ 606.907190] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.907190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.907190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.907190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.907190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.907190] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.907190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.907595] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.907764] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.907877] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.909914] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.909914] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.909914] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.909914] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.909914] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.909914] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ead2454-433c-40e4-962b-8e43443376bb is going to be updated. [ 606.912983] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.934929] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.934929] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.934929] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.934929] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.934929] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.936722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ead2454-433c-40e4-962b-8e43443376bb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.085614] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9546ef83-051f-4623-9fa9-0c95fc065e91 in Status: SUCCESS [ 607.085614] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.105162] env[70013]: INFO networking_nsxv3.common.synchronization [None req-c69d7869-ad52-4e0b-aea5-05f9114ddbba None None] Enqueued Resource ID: 17c31f4a-08c0-4cfe-b733-017e092f9617 with Priority: HIGHEST for action port [ 607.105720] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17c31f4a-08c0-4cfe-b733-017e092f9617 with Priority: HIGHEST for action port [ 607.107352] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-17c31f4a-08c0-4cfe-b733-017e092f9617 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.107539] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17c31f4a-08c0-4cfe-b733-017e092f9617" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.107576] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17c31f4a-08c0-4cfe-b733-017e092f9617" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.107817] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17c31f4a-08c0-4cfe-b733-017e092f9617" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.107898] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17c31f4a-08c0-4cfe-b733-017e092f9617',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.121184] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.121420] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.121614] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.122490] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.122490] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.122490] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port c7c80204-b8b4-46c6-8d93-38d4879119d3 not found, creating... [ 607.122490] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.122490] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.122669] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.122796] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.122919] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.123166] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.123330] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.123431] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.123637] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.123767] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.123903] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: c7c80204-b8b4-46c6-8d93-38d4879119d3 is going to be created. [ 607.147609] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.147609] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.147773] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.147921] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.149097] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.149097] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-c7c80204-b8b4-46c6-8d93-38d4879119d3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.199645] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16fadac6-f5a2-4997-b67b-221b3b4e45a8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.416102] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.610654] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 17c31f4a-08c0-4cfe-b733-017e092f9617 [ 607.610899] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.611058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.611168] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.611343] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.611699] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.612049] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:17c31f4a-08c0-4cfe-b733-017e092f9617 already deleted. [ 607.612049] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17c31f4a-08c0-4cfe-b733-017e092f9617" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.703680] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.703680] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.703680] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.703819] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.703819] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.703969] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 is going to be created. [ 607.736255] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.736255] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.736255] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.736255] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.736255] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.748749] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 in Status: UNINITIALIZED for 2s [ 607.848524] env[70013]: INFO networking_nsxv3.common.synchronization [req-5b76d997-0ee8-47b9-8f6e-e34f0fce7250 req-9be9ba1b-696e-410e-8ced-3b862535e1ed tempest-VolumesAdminNegativeTest-973826376 tempest-VolumesAdminNegativeTest-973826376-project-member] Enqueued Resource ID: aa7b798e-2025-4d46-88f3-8e44eeb87989 with Priority: HIGHEST for action security_group_members [ 607.850336] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7b798e-2025-4d46-88f3-8e44eeb87989 with Priority: HIGHEST for action security_group_members [ 607.850336] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7b798e-2025-4d46-88f3-8e44eeb87989 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.850336] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.850336] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.850336] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.850336] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.850336] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.850336] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.850628] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.850628] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.850683] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa7b798e-2025-4d46-88f3-8e44eeb87989',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.919142] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.919444] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.919444] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.919573] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.919662] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.919760] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 is going to be created. [ 607.944316] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.944516] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.944516] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.944822] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.944884] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.954164] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: UNINITIALIZED for 2s [ 608.355985] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.355985] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.355985] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.355985] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.355985] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.355985] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.355985] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.355985] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.355985] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.355985] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.355985] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa7b798e-2025-4d46-88f3-8e44eeb87989 already deleted. [ 608.355985] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.539844] env[70013]: INFO networking_nsxv3.common.synchronization [None req-33b9ceea-0133-43ab-ba5c-0379b05defc5 tempest-ServersTestFqdnHostnames-357486929 tempest-ServersTestFqdnHostnames-357486929-project-member] Enqueued Resource ID: 7a9726c0-7c30-4b11-81a1-9a9fcc702273 with Priority: HIGHEST for action security_group_rules [ 608.540420] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a9726c0-7c30-4b11-81a1-9a9fcc702273 with Priority: HIGHEST for action security_group_rules [ 608.540725] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a9726c0-7c30-4b11-81a1-9a9fcc702273 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.540881] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.540917] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.545020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.545020] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a9726c0-7c30-4b11-81a1-9a9fcc702273',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.646620] env[70013]: INFO networking_nsxv3.common.synchronization [None req-68cf491f-d8a4-4f7a-833c-2baea40961e5 None None] Enqueued Resource ID: bcb30312-9172-4407-8479-e44a5d762f73 with Priority: HIGHEST for action port [ 608.646910] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb30312-9172-4407-8479-e44a5d762f73 with Priority: HIGHEST for action port [ 608.647761] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcb30312-9172-4407-8479-e44a5d762f73 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.651264] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcb30312-9172-4407-8479-e44a5d762f73" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.651264] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcb30312-9172-4407-8479-e44a5d762f73" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.651558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcb30312-9172-4407-8479-e44a5d762f73" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.651623] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcb30312-9172-4407-8479-e44a5d762f73',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.870257] env[70013]: INFO networking_nsxv3.common.synchronization [req-59106c2f-8193-40dc-920f-59571ab8a6e8 req-7f808959-c86f-4a74-895e-1875f62d8c40 service nova] Enqueued Resource ID: 73383895-5111-42cc-a071-b2512b2f23af with Priority: HIGHEST for action security_group_rules [ 608.870696] env[70013]: INFO networking_nsxv3.common.synchronization [req-59106c2f-8193-40dc-920f-59571ab8a6e8 req-7f808959-c86f-4a74-895e-1875f62d8c40 service nova] Enqueued Resource ID: 73383895-5111-42cc-a071-b2512b2f23af with Priority: HIGHEST for action security_group_members [ 608.870977] env[70013]: INFO networking_nsxv3.common.synchronization [req-59106c2f-8193-40dc-920f-59571ab8a6e8 req-7f808959-c86f-4a74-895e-1875f62d8c40 service nova] Enqueued Resource ID: c7c80204-b8b4-46c6-8d93-38d4879119d3 with Priority: HIGHEST for action port [ 608.871345] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73383895-5111-42cc-a071-b2512b2f23af with Priority: HIGHEST for action security_group_rules [ 608.871571] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73383895-5111-42cc-a071-b2512b2f23af with Priority: HIGHEST for action security_group_members [ 608.873084] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7c80204-b8b4-46c6-8d93-38d4879119d3 with Priority: HIGHEST for action port [ 608.873941] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73383895-5111-42cc-a071-b2512b2f23af taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.874155] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.874276] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.874582] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.874736] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73383895-5111-42cc-a071-b2512b2f23af',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.876668] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-73383895-5111-42cc-a071-b2512b2f23af taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.876951] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.877097] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.877369] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.877612] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.877751] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.877860] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.878113] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.878255] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.878896] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73383895-5111-42cc-a071-b2512b2f23af',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.880059] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7c80204-b8b4-46c6-8d93-38d4879119d3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.880163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7c80204-b8b4-46c6-8d93-38d4879119d3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.880214] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7c80204-b8b4-46c6-8d93-38d4879119d3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.880461] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7c80204-b8b4-46c6-8d93-38d4879119d3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.880586] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7c80204-b8b4-46c6-8d93-38d4879119d3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.012372] env[70013]: INFO networking_nsxv3.common.synchronization [None req-d17a3968-c65c-47ca-b532-4a4efc1e9b72 tempest-ServersTestFqdnHostnames-357486929 tempest-ServersTestFqdnHostnames-357486929-project-member] Enqueued Resource ID: 7a9726c0-7c30-4b11-81a1-9a9fcc702273 with Priority: HIGHEST for action security_group_rules [ 609.014026] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a9726c0-7c30-4b11-81a1-9a9fcc702273 with Priority: HIGHEST for action security_group_rules [ 609.014659] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a9726c0-7c30-4b11-81a1-9a9fcc702273 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.014765] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.065118] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.065292] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.065364] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.065581] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.065670] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.065785] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a9726c0-7c30-4b11-81a1-9a9fcc702273 already deleted. [ 609.065949] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.066076] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.066270] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.066357] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a9726c0-7c30-4b11-81a1-9a9fcc702273',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.154360] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bcb30312-9172-4407-8479-e44a5d762f73 [ 609.158102] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.158102] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.158102] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.158102] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.158102] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.158102] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bcb30312-9172-4407-8479-e44a5d762f73 already deleted. [ 609.158102] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcb30312-9172-4407-8479-e44a5d762f73" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.224123] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-187 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.224353] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-187" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.224475] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-187" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.224851] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-187" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.225643] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.225847] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.225966] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.230429] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.230474] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.230778] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 609.230849] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 609.230925] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 609.231041] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 609.231157] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 609.231330] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 609.231506] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 609.239393] env[70013]: INFO networking_nsxv3.common.synchronization [req-bc7c3462-7037-4c3a-a7e7-89d00de8fe93 req-715473bb-f8c8-44a4-b211-88edcff50116 tempest-SecurityGroupRulesTestJSON-1067418828 tempest-SecurityGroupRulesTestJSON-1067418828-project-member] Enqueued Resource ID: 5ebed56f-6b7b-4bd1-9c01-a0a2c8964c74 with Priority: HIGHEST for action security_group_rules [ 609.239635] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ebed56f-6b7b-4bd1-9c01-a0a2c8964c74 with Priority: HIGHEST for action security_group_rules [ 609.240167] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ebed56f-6b7b-4bd1-9c01-a0a2c8964c74 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.240303] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ebed56f-6b7b-4bd1-9c01-a0a2c8964c74" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.240414] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ebed56f-6b7b-4bd1-9c01-a0a2c8964c74" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.240630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ebed56f-6b7b-4bd1-9c01-a0a2c8964c74" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.240693] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ebed56f-6b7b-4bd1-9c01-a0a2c8964c74',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.249131] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 609.249349] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 609.249470] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 609.249702] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-187" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.250087] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-27c6992d-5e25-418c-83e7-a49ce44dee0e taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.250564] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-27c6992d-5e25-418c-83e7-a49ce44dee0e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.250564] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-27c6992d-5e25-418c-83e7-a49ce44dee0e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.250741] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-27c6992d-5e25-418c-83e7-a49ce44dee0e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.251418] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27c6992d-5e25-418c-83e7-a49ce44dee0e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.378407] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-73383895-5111-42cc-a071-b2512b2f23af taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.378618] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.382192] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('73383895-5111-42cc-a071-b2512b2f23af',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.383158] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c7c80204-b8b4-46c6-8d93-38d4879119d3 with status ACTIVE [ 609.383408] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.383521] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.383597] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.384530] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.384530] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.384530] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.384530] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.384530] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.384530] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.384530] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.384839] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.385267] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.385374] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.385555] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.385661] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.385772] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c7c80204-b8b4-46c6-8d93-38d4879119d3 is going to be updated. [ 609.412186] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.412186] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.412186] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.412186] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.412186] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.412186] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7c80204-b8b4-46c6-8d93-38d4879119d3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.589139] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.589139] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.589139] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.589139] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.589139] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.589139] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a9726c0-7c30-4b11-81a1-9a9fcc702273 already deleted. [ 609.589139] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.652638] env[70013]: INFO networking_nsxv3.common.synchronization [None req-3dd1873a-25b2-4e84-b0b6-63245a83480e None None] Enqueued Resource ID: 5072452a-d1b4-453a-94ac-56c682e2ef50 with Priority: HIGHEST for action port [ 609.653174] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5072452a-d1b4-453a-94ac-56c682e2ef50 with Priority: HIGHEST for action port [ 609.653881] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-5072452a-d1b4-453a-94ac-56c682e2ef50 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.654049] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5072452a-d1b4-453a-94ac-56c682e2ef50" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.654129] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5072452a-d1b4-453a-94ac-56c682e2ef50" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.654387] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5072452a-d1b4-453a-94ac-56c682e2ef50" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.654465] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5072452a-d1b4-453a-94ac-56c682e2ef50',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.755530] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.755765] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.755897] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.756206] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.757812] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.757812] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 27c6992d-5e25-418c-83e7-a49ce44dee0e not found, creating... [ 609.757812] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.757812] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.757812] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.757812] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.757812] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.757812] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.758389] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.758389] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.758389] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.758389] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.758537] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 27c6992d-5e25-418c-83e7-a49ce44dee0e is going to be created. [ 609.763064] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.763321] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.763429] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.763628] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.764731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.764731] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ebed56f-6b7b-4bd1-9c01-a0a2c8964c74 already deleted. [ 609.764731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ebed56f-6b7b-4bd1-9c01-a0a2c8964c74" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.777678] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 in Status: SUCCESS [ 609.778202] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.778490] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.779267] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.779267] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.779267] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.779267] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.780278] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.780278] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.780278] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.780278] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16fadac6-f5a2-4997-b67b-221b3b4e45a8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.789251] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.789486] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.789580] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.789877] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.790123] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.790357] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-27c6992d-5e25-418c-83e7-a49ce44dee0e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.890869] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('73383895-5111-42cc-a071-b2512b2f23af',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.966457] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: SUCCESS [ 609.966457] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.966457] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.966457] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.966457] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.966457] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.966457] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.966457] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.966457] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.966457] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.966457] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.160444] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5072452a-d1b4-453a-94ac-56c682e2ef50 [ 610.161726] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.161726] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.161726] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.161726] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.161726] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.161726] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5072452a-d1b4-453a-94ac-56c682e2ef50 already deleted. [ 610.161726] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5072452a-d1b4-453a-94ac-56c682e2ef50" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.285248] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16fadac6-f5a2-4997-b67b-221b3b4e45a8 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.285248] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.285370] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.285764] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.285764] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.285764] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.285939] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.285976] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.286076] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.286157] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.286296] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16fadac6-f5a2-4997-b67b-221b3b4e45a8 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.286503] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.286503] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.286590] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.286700] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.286855] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.286855] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.286976] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.287062] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.287155] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.287227] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16fadac6-f5a2-4997-b67b-221b3b4e45a8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.373319] env[70013]: INFO networking_nsxv3.common.synchronization [None req-95336fcf-c785-4490-98a3-01474a076a4d None None] Enqueued Resource ID: 18c93d14-0b1c-4bac-a1a2-190404cf3ca3 with Priority: HIGHEST for action port [ 610.373319] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c93d14-0b1c-4bac-a1a2-190404cf3ca3 with Priority: HIGHEST for action port [ 610.373319] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-18c93d14-0b1c-4bac-a1a2-190404cf3ca3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.373319] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18c93d14-0b1c-4bac-a1a2-190404cf3ca3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.373319] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18c93d14-0b1c-4bac-a1a2-190404cf3ca3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.373497] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18c93d14-0b1c-4bac-a1a2-190404cf3ca3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.373497] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18c93d14-0b1c-4bac-a1a2-190404cf3ca3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.390781] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.390781] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.390781] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.390946] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.391074] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.391210] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73383895-5111-42cc-a071-b2512b2f23af is going to be created. [ 610.415652] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.417494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.418159] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.418159] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.418159] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.427787] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73383895-5111-42cc-a071-b2512b2f23af in Status: UNINITIALIZED for 2s [ 610.469670] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.469840] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.469911] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.470202] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.470412] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.470499] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.470538] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.470807] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.470932] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.471060] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.471249] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.471408] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.471500] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.471658] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.471838] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.471976] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.472086] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.472394] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.472394] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.472394] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.472562] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.512310] env[70013]: INFO networking_nsxv3.common.synchronization [None req-c26948fb-a79d-4289-b197-2fb1bca25e14 None None] Enqueued Resource ID: 7cbdd0ac-6e44-44eb-bc60-d198d029f3f1 with Priority: HIGHEST for action port [ 610.514037] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cbdd0ac-6e44-44eb-bc60-d198d029f3f1 with Priority: HIGHEST for action port [ 610.514037] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cbdd0ac-6e44-44eb-bc60-d198d029f3f1 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.514037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cbdd0ac-6e44-44eb-bc60-d198d029f3f1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.514037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cbdd0ac-6e44-44eb-bc60-d198d029f3f1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.514037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cbdd0ac-6e44-44eb-bc60-d198d029f3f1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.514037] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cbdd0ac-6e44-44eb-bc60-d198d029f3f1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.792888] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16fadac6-f5a2-4997-b67b-221b3b4e45a8: rpc.has_security_group_logging(os_id): False [ 610.804246] env[70013]: INFO networking_nsxv3.common.synchronization [None req-fe52025a-f1c1-42d9-9545-a44584ba62b6 None None] Enqueued Resource ID: 54ffc93b-c08b-404f-8d88-b2a90a16e9b9 with Priority: HIGHEST for action port [ 610.804246] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54ffc93b-c08b-404f-8d88-b2a90a16e9b9 with Priority: HIGHEST for action port [ 610.804246] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-54ffc93b-c08b-404f-8d88-b2a90a16e9b9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.804246] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54ffc93b-c08b-404f-8d88-b2a90a16e9b9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.804246] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54ffc93b-c08b-404f-8d88-b2a90a16e9b9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.804246] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54ffc93b-c08b-404f-8d88-b2a90a16e9b9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.804246] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54ffc93b-c08b-404f-8d88-b2a90a16e9b9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.814268] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.814268] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.814268] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.814268] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.814268] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.814268] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.814268] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.814268] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.814268] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.814268] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.814268] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.814268] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.814268] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.814268] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.814268] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.814764] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.814764] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.814764] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.814764] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.814764] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.814764] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 is going to be created. [ 610.870742] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.870907] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.870960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.871212] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.871397] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.880050] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18c93d14-0b1c-4bac-a1a2-190404cf3ca3 [ 610.880925] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.881096] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.881182] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.881403] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.881496] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.881591] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18c93d14-0b1c-4bac-a1a2-190404cf3ca3 already deleted. [ 610.881673] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18c93d14-0b1c-4bac-a1a2-190404cf3ca3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.882521] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 in Status: IN_PROGRESS for 2s [ 610.975264] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc1b714b-7da7-41dc-b21f-d8ad167c33d9: rpc.has_security_group_logging(os_id): False [ 610.992420] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.993066] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.993066] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.993066] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.993066] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.993281] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.993389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.993453] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.993633] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.993730] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.993946] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.994056] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.994144] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.994265] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.994505] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.994874] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.994957] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.995424] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.995686] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.995832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.995977] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 is going to be created. [ 611.017881] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7cbdd0ac-6e44-44eb-bc60-d198d029f3f1 [ 611.017881] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.017881] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.017881] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.017881] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.017881] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.017881] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7cbdd0ac-6e44-44eb-bc60-d198d029f3f1 already deleted. [ 611.017881] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cbdd0ac-6e44-44eb-bc60-d198d029f3f1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.055214] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.055214] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.055214] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.055214] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.055214] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.064985] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: IN_PROGRESS for 2s [ 611.307713] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 54ffc93b-c08b-404f-8d88-b2a90a16e9b9 [ 611.308058] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.308141] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.308141] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.308391] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.308484] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.308581] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:54ffc93b-c08b-404f-8d88-b2a90a16e9b9 already deleted. [ 611.308673] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54ffc93b-c08b-404f-8d88-b2a90a16e9b9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.577739] env[70013]: INFO networking_nsxv3.common.synchronization [req-5b76d997-0ee8-47b9-8f6e-e34f0fce7250 req-446c14c7-3646-4183-b903-b9cb21c97c78 service nova] Enqueued Resource ID: aa7b798e-2025-4d46-88f3-8e44eeb87989 with Priority: HIGHEST for action security_group_rules [ 611.577922] env[70013]: INFO networking_nsxv3.common.synchronization [req-5b76d997-0ee8-47b9-8f6e-e34f0fce7250 req-446c14c7-3646-4183-b903-b9cb21c97c78 service nova] Enqueued Resource ID: aa7b798e-2025-4d46-88f3-8e44eeb87989 with Priority: HIGHEST for action security_group_members [ 611.578108] env[70013]: INFO networking_nsxv3.common.synchronization [req-5b76d997-0ee8-47b9-8f6e-e34f0fce7250 req-446c14c7-3646-4183-b903-b9cb21c97c78 service nova] Enqueued Resource ID: 27c6992d-5e25-418c-83e7-a49ce44dee0e with Priority: HIGHEST for action port [ 611.578770] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7b798e-2025-4d46-88f3-8e44eeb87989 with Priority: HIGHEST for action security_group_rules [ 611.578911] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7b798e-2025-4d46-88f3-8e44eeb87989 with Priority: HIGHEST for action security_group_members [ 611.578970] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27c6992d-5e25-418c-83e7-a49ce44dee0e with Priority: HIGHEST for action port [ 611.579294] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa7b798e-2025-4d46-88f3-8e44eeb87989 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.579426] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.579490] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.579707] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.579787] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa7b798e-2025-4d46-88f3-8e44eeb87989',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.580730] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7b798e-2025-4d46-88f3-8e44eeb87989 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.581200] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.581200] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.581200] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.581656] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.581771] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.581849] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.582067] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.582161] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.582301] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa7b798e-2025-4d46-88f3-8e44eeb87989',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.585647] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-27c6992d-5e25-418c-83e7-a49ce44dee0e taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.585647] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27c6992d-5e25-418c-83e7-a49ce44dee0e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.585647] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27c6992d-5e25-418c-83e7-a49ce44dee0e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.585647] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27c6992d-5e25-418c-83e7-a49ce44dee0e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.585647] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27c6992d-5e25-418c-83e7-a49ce44dee0e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.087308] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7b798e-2025-4d46-88f3-8e44eeb87989 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.087443] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.090151] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 27c6992d-5e25-418c-83e7-a49ce44dee0e with status ACTIVE [ 612.090416] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.090553] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.090637] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.090853] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.090952] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.091140] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.091233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.091293] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.091478] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.091553] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.091808] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.091861] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.091894] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.092044] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.092125] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.092207] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 27c6992d-5e25-418c-83e7-a49ce44dee0e is going to be updated. [ 612.096170] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa7b798e-2025-4d46-88f3-8e44eeb87989',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.114269] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.114428] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.114497] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.114763] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.114923] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.115207] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27c6992d-5e25-418c-83e7-a49ce44dee0e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.284007] env[70013]: INFO networking_nsxv3.common.synchronization [None req-5bcbbda7-6902-4036-86f9-36e354743e31 None None] Enqueued Resource ID: 3716b7f3-9b60-4261-8cb6-035fa6db88db with Priority: HIGHEST for action port [ 612.284270] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3716b7f3-9b60-4261-8cb6-035fa6db88db with Priority: HIGHEST for action port [ 612.284832] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-3716b7f3-9b60-4261-8cb6-035fa6db88db taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.284956] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3716b7f3-9b60-4261-8cb6-035fa6db88db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.285036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3716b7f3-9b60-4261-8cb6-035fa6db88db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.285292] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3716b7f3-9b60-4261-8cb6-035fa6db88db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.287246] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3716b7f3-9b60-4261-8cb6-035fa6db88db',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.439943] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73383895-5111-42cc-a071-b2512b2f23af in Status: SUCCESS [ 612.440716] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.440716] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.440716] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.441186] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.441186] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.441186] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.443856] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.443856] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.443856] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.443856] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('73383895-5111-42cc-a071-b2512b2f23af',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.597807] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa7b798e-2025-4d46-88f3-8e44eeb87989',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.736119] env[70013]: INFO networking_nsxv3.common.synchronization [None req-5b6ee69e-59b5-4a8c-9ac8-4acfbd2a4a2d None None] Enqueued Resource ID: b09d473d-7e6c-42d7-aba4-c163b4c2329e with Priority: HIGHEST for action port [ 612.736796] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b09d473d-7e6c-42d7-aba4-c163b4c2329e with Priority: HIGHEST for action port [ 612.736937] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-b09d473d-7e6c-42d7-aba4-c163b4c2329e taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.737078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b09d473d-7e6c-42d7-aba4-c163b4c2329e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.737145] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b09d473d-7e6c-42d7-aba4-c163b4c2329e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.737476] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b09d473d-7e6c-42d7-aba4-c163b4c2329e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.737476] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b09d473d-7e6c-42d7-aba4-c163b4c2329e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.791415] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3716b7f3-9b60-4261-8cb6-035fa6db88db [ 612.791607] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.791742] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.791810] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.792034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.792122] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.792212] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3716b7f3-9b60-4261-8cb6-035fa6db88db already deleted. [ 612.792291] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3716b7f3-9b60-4261-8cb6-035fa6db88db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.896867] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 in Status: SUCCESS [ 612.896867] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.946984] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('73383895-5111-42cc-a071-b2512b2f23af',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.079256] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: SUCCESS [ 613.079256] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.100283] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.100283] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.100283] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.100283] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.100283] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.101052] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa7b798e-2025-4d46-88f3-8e44eeb87989 is going to be created. [ 613.122705] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.122705] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.122884] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.122952] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.123132] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.133948] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7b798e-2025-4d46-88f3-8e44eeb87989 in Status: UNINITIALIZED for 2s [ 613.243528] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b09d473d-7e6c-42d7-aba4-c163b4c2329e [ 613.243528] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.243528] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.243778] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.243778] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.243846] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.244669] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b09d473d-7e6c-42d7-aba4-c163b4c2329e already deleted. [ 613.244669] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b09d473d-7e6c-42d7-aba4-c163b4c2329e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.448726] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 73383895-5111-42cc-a071-b2512b2f23af: rpc.has_security_group_logging(os_id): False [ 613.467050] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.467050] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.467168] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.467323] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.467411] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.467656] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.467755] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.467818] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.467971] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.468053] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.468147] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73383895-5111-42cc-a071-b2512b2f23af is going to be created. [ 613.526424] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.526630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.526630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.526887] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.527191] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.542533] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73383895-5111-42cc-a071-b2512b2f23af in Status: IN_PROGRESS for 2s [ 613.624168] env[70013]: INFO networking_nsxv3.common.synchronization [None req-abb65cb0-2abb-4545-9982-e3151a185132 None None] Enqueued Resource ID: 5341d810-26e3-40d2-8601-02f8ef82f6e7 with Priority: HIGHEST for action port [ 613.624327] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5341d810-26e3-40d2-8601-02f8ef82f6e7 with Priority: HIGHEST for action port [ 613.626518] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-5341d810-26e3-40d2-8601-02f8ef82f6e7 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.626518] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5341d810-26e3-40d2-8601-02f8ef82f6e7" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.626518] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5341d810-26e3-40d2-8601-02f8ef82f6e7" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.626518] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5341d810-26e3-40d2-8601-02f8ef82f6e7" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.627154] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5341d810-26e3-40d2-8601-02f8ef82f6e7',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.131828] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5341d810-26e3-40d2-8601-02f8ef82f6e7 [ 614.132084] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.132229] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.132295] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.132584] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.132584] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.132700] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5341d810-26e3-40d2-8601-02f8ef82f6e7 already deleted. [ 614.132751] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5341d810-26e3-40d2-8601-02f8ef82f6e7" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.160357] env[70013]: INFO networking_nsxv3.common.synchronization [None req-bed48bdb-15ef-4028-87a4-142a45ab02fc None None] Enqueued Resource ID: 4498b2dc-4dac-480a-a6aa-21509f8bd387 with Priority: HIGHEST for action port [ 614.160357] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4498b2dc-4dac-480a-a6aa-21509f8bd387 with Priority: HIGHEST for action port [ 614.160357] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-4498b2dc-4dac-480a-a6aa-21509f8bd387 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.160357] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4498b2dc-4dac-480a-a6aa-21509f8bd387" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.160357] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4498b2dc-4dac-480a-a6aa-21509f8bd387" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.160709] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4498b2dc-4dac-480a-a6aa-21509f8bd387" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.160842] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4498b2dc-4dac-480a-a6aa-21509f8bd387',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.664070] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4498b2dc-4dac-480a-a6aa-21509f8bd387 [ 614.664070] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.664070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.664638] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.664834] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.664834] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.664913] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4498b2dc-4dac-480a-a6aa-21509f8bd387 already deleted. [ 614.664993] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4498b2dc-4dac-480a-a6aa-21509f8bd387" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.142919] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7b798e-2025-4d46-88f3-8e44eeb87989 in Status: SUCCESS [ 615.143114] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.143280] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.143695] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.143695] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.144238] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.144238] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.144238] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.144238] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.144238] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.144378] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa7b798e-2025-4d46-88f3-8e44eeb87989',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.231958] env[70013]: INFO networking_nsxv3.common.synchronization [None req-48bd7318-0a27-4b3c-a34f-a2ede8c5c0c6 None None] Enqueued Resource ID: b9f9f988-a17e-475c-a316-bc59762fcd5c with Priority: HIGHEST for action port [ 615.232495] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9f9f988-a17e-475c-a316-bc59762fcd5c with Priority: HIGHEST for action port [ 615.232901] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9f9f988-a17e-475c-a316-bc59762fcd5c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.232986] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9f9f988-a17e-475c-a316-bc59762fcd5c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.232986] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9f9f988-a17e-475c-a316-bc59762fcd5c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.234535] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9f9f988-a17e-475c-a316-bc59762fcd5c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.234535] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9f9f988-a17e-475c-a316-bc59762fcd5c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.557377] env[70013]: INFO networking_nsxv3.common.synchronization [None req-f831319c-d10f-46e3-b9b1-da12b8501312 tempest-AttachVolumeTestJSON-972861423 tempest-AttachVolumeTestJSON-972861423-project-member] Enqueued Resource ID: 5333cddc-c089-40b3-9eba-dc3f40477cac with Priority: HIGHEST for action security_group_rules [ 615.558743] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 73383895-5111-42cc-a071-b2512b2f23af in Status: SUCCESS [ 615.558988] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.559762] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5333cddc-c089-40b3-9eba-dc3f40477cac with Priority: HIGHEST for action security_group_rules [ 615.559762] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5333cddc-c089-40b3-9eba-dc3f40477cac taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.559925] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.559925] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.560860] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.560860] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5333cddc-c089-40b3-9eba-dc3f40477cac',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.609578] env[70013]: INFO networking_nsxv3.common.synchronization [req-06697e92-9b64-4c03-ae3b-e0e4e9224621 req-9ad2c3c6-42fb-4e56-bdb1-cd8a0601422c tempest-VolumesAssistedSnapshotsTest-996933272 tempest-VolumesAssistedSnapshotsTest-996933272-project-member] Enqueued Resource ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd with Priority: HIGHEST for action security_group_members [ 615.609633] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd with Priority: HIGHEST for action security_group_members [ 615.610627] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.611240] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.611275] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.612369] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.615153] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.615153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.615153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.615153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.615153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.615153] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.646501] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa7b798e-2025-4d46-88f3-8e44eeb87989',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.736399] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9f9f988-a17e-475c-a316-bc59762fcd5c [ 615.737048] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.737048] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.737048] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.737659] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.737853] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.738455] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9f9f988-a17e-475c-a316-bc59762fcd5c already deleted. [ 615.738455] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9f9f988-a17e-475c-a316-bc59762fcd5c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.917302] env[70013]: INFO networking_nsxv3.common.synchronization [None req-9c9a617d-d30a-4e24-9b72-7880efd053a8 None None] Enqueued Resource ID: 101fd288-965e-4b2a-8498-8e7a24772c3c with Priority: HIGHEST for action port [ 615.918198] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 101fd288-965e-4b2a-8498-8e7a24772c3c with Priority: HIGHEST for action port [ 615.918198] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-101fd288-965e-4b2a-8498-8e7a24772c3c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.918773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-101fd288-965e-4b2a-8498-8e7a24772c3c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.918773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-101fd288-965e-4b2a-8498-8e7a24772c3c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.918773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-101fd288-965e-4b2a-8498-8e7a24772c3c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.918773] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('101fd288-965e-4b2a-8498-8e7a24772c3c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.967091] env[70013]: INFO networking_nsxv3.common.synchronization [None req-803a0e0f-8684-484e-9a3c-fe5872441f9c tempest-AttachVolumeTestJSON-972861423 tempest-AttachVolumeTestJSON-972861423-project-member] Enqueued Resource ID: 5333cddc-c089-40b3-9eba-dc3f40477cac with Priority: HIGHEST for action security_group_rules [ 615.967091] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5333cddc-c089-40b3-9eba-dc3f40477cac with Priority: HIGHEST for action security_group_rules [ 615.968196] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5333cddc-c089-40b3-9eba-dc3f40477cac taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.968953] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.083185] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.083185] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.083393] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.083630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.083630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.083757] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5333cddc-c089-40b3-9eba-dc3f40477cac already deleted. [ 616.083757] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.084044] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.084115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.084220] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5333cddc-c089-40b3-9eba-dc3f40477cac',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.118263] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.118447] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.118512] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.118731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.118829] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.119048] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.119145] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.119760] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.119760] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.119760] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.119760] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd already deleted. [ 616.119760] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.152559] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa7b798e-2025-4d46-88f3-8e44eeb87989: rpc.has_security_group_logging(os_id): False [ 616.170045] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.170199] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.170305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.170564] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.170663] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.170934] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.171055] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.171132] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.172360] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.172472] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.172580] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa7b798e-2025-4d46-88f3-8e44eeb87989 is going to be created. [ 616.234950] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.235031] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.235827] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.236199] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.236361] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.247235] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa7b798e-2025-4d46-88f3-8e44eeb87989 in Status: IN_PROGRESS for 2s [ 616.422430] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 101fd288-965e-4b2a-8498-8e7a24772c3c [ 616.423067] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.423227] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.423302] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.423529] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.423651] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.423763] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:101fd288-965e-4b2a-8498-8e7a24772c3c already deleted. [ 616.423850] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-101fd288-965e-4b2a-8498-8e7a24772c3c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.603303] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.603921] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.606960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.606960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.606960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.606960] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5333cddc-c089-40b3-9eba-dc3f40477cac already deleted. [ 616.606960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.721237] env[70013]: INFO networking_nsxv3.common.synchronization [None req-b44c3539-b7af-4aba-9291-a1e9e8226c1f None None] Enqueued Resource ID: 2edc992c-9d1c-4bde-9042-44139acce03f with Priority: HIGHEST for action port [ 616.721813] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2edc992c-9d1c-4bde-9042-44139acce03f with Priority: HIGHEST for action port [ 616.722649] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-2edc992c-9d1c-4bde-9042-44139acce03f taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.722649] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2edc992c-9d1c-4bde-9042-44139acce03f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.722649] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2edc992c-9d1c-4bde-9042-44139acce03f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.722649] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2edc992c-9d1c-4bde-9042-44139acce03f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.723259] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2edc992c-9d1c-4bde-9042-44139acce03f',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.740122] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-937 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.740441] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-937" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.740690] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-937" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.740965] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-937" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.741643] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.741643] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.741776] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.741976] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.742155] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.742363] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 616.742554] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 616.742609] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 616.742708] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 616.742825] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 616.742931] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 616.743075] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 616.762819] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 616.762995] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 616.763151] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 616.763327] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-937" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.763636] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-3af5d84e-e814-4689-aa70-e63d58041799 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.763805] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-3af5d84e-e814-4689-aa70-e63d58041799" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.763925] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-3af5d84e-e814-4689-aa70-e63d58041799" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.764252] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-3af5d84e-e814-4689-aa70-e63d58041799" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.764389] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3af5d84e-e814-4689-aa70-e63d58041799',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.225616] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2edc992c-9d1c-4bde-9042-44139acce03f [ 617.225703] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.225798] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.225864] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.226099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.226188] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.226606] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2edc992c-9d1c-4bde-9042-44139acce03f already deleted. [ 617.226606] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2edc992c-9d1c-4bde-9042-44139acce03f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.268340] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.268770] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.270844] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.271326] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.271729] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.272058] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 3af5d84e-e814-4689-aa70-e63d58041799 not found, creating... [ 617.273020] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.273020] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.273020] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.274174] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.274174] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.274174] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.274426] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.274537] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.274789] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.274958] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.275124] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 3af5d84e-e814-4689-aa70-e63d58041799 is going to be created. [ 617.294063] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.294164] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.294866] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.294866] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.294866] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.295070] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-3af5d84e-e814-4689-aa70-e63d58041799" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.301043] env[70013]: INFO networking_nsxv3.common.synchronization [req-bfa7f5ef-38db-4e9f-ae38-739bce9c49a2 req-34ae93f7-5a04-49a4-811f-2ef2a205e0e3 tempest-ServerDiagnosticsNegativeTest-1667465715 tempest-ServerDiagnosticsNegativeTest-1667465715-project-member] Enqueued Resource ID: 9546ef83-051f-4623-9fa9-0c95fc065e91 with Priority: HIGHEST for action security_group_members [ 617.301828] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9546ef83-051f-4623-9fa9-0c95fc065e91 with Priority: HIGHEST for action security_group_members [ 617.304172] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9546ef83-051f-4623-9fa9-0c95fc065e91 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.304172] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.304172] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.304172] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.304172] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.304172] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.304172] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.304172] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.304172] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.304172] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9546ef83-051f-4623-9fa9-0c95fc065e91',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.750116] env[70013]: INFO networking_nsxv3.common.synchronization [req-bee8f6f6-4e15-42b0-9089-2e87fc2ffdba req-1bf136d5-7b0a-4689-a6a8-caf7b6ad7ff6 tempest-InstanceActionsNegativeTestJSON-1332608593 tempest-InstanceActionsNegativeTestJSON-1332608593-project-member] Enqueued Resource ID: c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 with Priority: HIGHEST for action security_group_members [ 617.750116] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 with Priority: HIGHEST for action security_group_members [ 617.750794] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.751200] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.751443] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.752284] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.752551] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.752763] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.752967] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.753272] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.753456] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.753654] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c24dbd-a3bb-4ba7-8bd1-0206c6519816',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.806835] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.807054] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.809735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.809735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.809735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.809735] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.809735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.809735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.809735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.809735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.809735] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9546ef83-051f-4623-9fa9-0c95fc065e91 is going to be updated. [ 617.909095] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.909247] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.909342] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.909804] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.909991] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.920089] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9546ef83-051f-4623-9fa9-0c95fc065e91 in Status: IN_PROGRESS for 2s [ 618.110779] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-957 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.111047] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-957" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.111203] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-957" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.111572] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-957" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.111831] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.111989] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.112341] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.112478] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.112653] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.112889] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 618.113020] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 618.113145] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 618.113524] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 618.113684] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 618.113855] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 618.114536] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 618.141431] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 618.141746] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 618.141887] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 618.142083] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-957" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.142408] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-d435ef58-a090-4c51-b69d-6bafa2b6ff27 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.142583] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-d435ef58-a090-4c51-b69d-6bafa2b6ff27" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.142701] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-d435ef58-a090-4c51-b69d-6bafa2b6ff27" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.143035] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-d435ef58-a090-4c51-b69d-6bafa2b6ff27" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.143178] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d435ef58-a090-4c51-b69d-6bafa2b6ff27',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.258793] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.258793] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.258793] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.258793] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.258793] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.258793] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.259080] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.259156] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.259326] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.259413] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.259553] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 already deleted. [ 618.259654] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.266181] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa7b798e-2025-4d46-88f3-8e44eeb87989 in Status: SUCCESS [ 618.266388] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.646427] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.646560] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.646689] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.646974] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.647132] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.647710] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port d435ef58-a090-4c51-b69d-6bafa2b6ff27 not found, creating... [ 618.647710] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.647710] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.647870] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.647989] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.648165] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.648413] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.648563] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.648673] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.649143] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.649316] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.649455] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: d435ef58-a090-4c51-b69d-6bafa2b6ff27 is going to be created. [ 618.670492] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.670704] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.670828] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.671417] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.672306] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.672306] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-d435ef58-a090-4c51-b69d-6bafa2b6ff27" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.778803] env[70013]: INFO networking_nsxv3.common.synchronization [req-06697e92-9b64-4c03-ae3b-e0e4e9224621 req-f4c08d80-627a-4e49-b74d-2ff674c187b2 service nova] Enqueued Resource ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd with Priority: HIGHEST for action security_group_rules [ 618.779177] env[70013]: INFO networking_nsxv3.common.synchronization [req-06697e92-9b64-4c03-ae3b-e0e4e9224621 req-f4c08d80-627a-4e49-b74d-2ff674c187b2 service nova] Enqueued Resource ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd with Priority: HIGHEST for action security_group_members [ 618.779177] env[70013]: INFO networking_nsxv3.common.synchronization [req-06697e92-9b64-4c03-ae3b-e0e4e9224621 req-f4c08d80-627a-4e49-b74d-2ff674c187b2 service nova] Enqueued Resource ID: 3af5d84e-e814-4689-aa70-e63d58041799 with Priority: HIGHEST for action port [ 618.779840] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd with Priority: HIGHEST for action security_group_rules [ 618.779840] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd with Priority: HIGHEST for action security_group_members [ 618.781453] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3af5d84e-e814-4689-aa70-e63d58041799 with Priority: HIGHEST for action port [ 618.781861] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.781960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.781960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.782389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.782389] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.783739] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.783856] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.783921] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.784146] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.784722] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.784832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.784889] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.785337] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.785337] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.785337] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.785992] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-3af5d84e-e814-4689-aa70-e63d58041799 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.786127] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3af5d84e-e814-4689-aa70-e63d58041799" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.786196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3af5d84e-e814-4689-aa70-e63d58041799" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.786343] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3af5d84e-e814-4689-aa70-e63d58041799" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.786416] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3af5d84e-e814-4689-aa70-e63d58041799',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.960424] env[70013]: INFO networking_nsxv3.common.synchronization [None req-2083d957-e993-474b-9f1a-47be3f94c0cc None None] Enqueued Resource ID: 0a37265f-5d90-49ac-b8e8-6e1dfc7aa5a8 with Priority: HIGHEST for action port [ 618.961194] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a37265f-5d90-49ac-b8e8-6e1dfc7aa5a8 with Priority: HIGHEST for action port [ 618.961579] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a37265f-5d90-49ac-b8e8-6e1dfc7aa5a8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.961647] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a37265f-5d90-49ac-b8e8-6e1dfc7aa5a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.961731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a37265f-5d90-49ac-b8e8-6e1dfc7aa5a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.963416] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a37265f-5d90-49ac-b8e8-6e1dfc7aa5a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.963416] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a37265f-5d90-49ac-b8e8-6e1dfc7aa5a8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.288030] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.288216] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.288416] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.289404] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3af5d84e-e814-4689-aa70-e63d58041799 with status ACTIVE [ 619.289521] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.289636] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.290095] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.290366] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.290504] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.291183] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.291561] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.291630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.291801] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.291904] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.292083] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.292181] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.292246] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.294151] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.294151] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.294151] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3af5d84e-e814-4689-aa70-e63d58041799 is going to be updated. [ 619.314796] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.315528] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.315617] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.315831] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.315970] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.316148] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3af5d84e-e814-4689-aa70-e63d58041799" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.372575] env[70013]: INFO networking_nsxv3.common.synchronization [req-bee8f6f6-4e15-42b0-9089-2e87fc2ffdba req-1baa44ee-63b2-4bb1-909e-a7558328fa4b service nova] Enqueued Resource ID: c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 with Priority: HIGHEST for action security_group_rules [ 619.372841] env[70013]: INFO networking_nsxv3.common.synchronization [req-bee8f6f6-4e15-42b0-9089-2e87fc2ffdba req-1baa44ee-63b2-4bb1-909e-a7558328fa4b service nova] Enqueued Resource ID: c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 with Priority: HIGHEST for action security_group_members [ 619.373139] env[70013]: INFO networking_nsxv3.common.synchronization [req-bee8f6f6-4e15-42b0-9089-2e87fc2ffdba req-1baa44ee-63b2-4bb1-909e-a7558328fa4b service nova] Enqueued Resource ID: d435ef58-a090-4c51-b69d-6bafa2b6ff27 with Priority: HIGHEST for action port [ 619.374172] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 with Priority: HIGHEST for action security_group_rules [ 619.374367] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 with Priority: HIGHEST for action security_group_members [ 619.375153] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d435ef58-a090-4c51-b69d-6bafa2b6ff27 with Priority: HIGHEST for action port [ 619.375153] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.375273] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.375305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.375534] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.375616] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0c24dbd-a3bb-4ba7-8bd1-0206c6519816',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.377752] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.377752] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.377752] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.377752] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.377752] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.377752] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.377752] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.377752] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.377752] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.377752] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c24dbd-a3bb-4ba7-8bd1-0206c6519816',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.379699] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-d435ef58-a090-4c51-b69d-6bafa2b6ff27 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.379699] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d435ef58-a090-4c51-b69d-6bafa2b6ff27" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.379699] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d435ef58-a090-4c51-b69d-6bafa2b6ff27" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.379699] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d435ef58-a090-4c51-b69d-6bafa2b6ff27" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.380072] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d435ef58-a090-4c51-b69d-6bafa2b6ff27',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.465435] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a37265f-5d90-49ac-b8e8-6e1dfc7aa5a8 [ 619.465435] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.465435] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.465435] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.465435] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.465435] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.465435] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a37265f-5d90-49ac-b8e8-6e1dfc7aa5a8 already deleted. [ 619.465435] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a37265f-5d90-49ac-b8e8-6e1dfc7aa5a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.541531] env[70013]: INFO networking_nsxv3.common.synchronization [None req-515cdf8a-326b-4252-8525-518507621c6c None None] Enqueued Resource ID: 00277b8e-3f38-416c-8a75-cc28d3dd5af4 with Priority: HIGHEST for action port [ 619.542557] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00277b8e-3f38-416c-8a75-cc28d3dd5af4 with Priority: HIGHEST for action port [ 619.542983] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-00277b8e-3f38-416c-8a75-cc28d3dd5af4 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.543240] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00277b8e-3f38-416c-8a75-cc28d3dd5af4" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.543395] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00277b8e-3f38-416c-8a75-cc28d3dd5af4" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.544910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00277b8e-3f38-416c-8a75-cc28d3dd5af4" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.544910] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00277b8e-3f38-416c-8a75-cc28d3dd5af4',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.645229] env[70013]: INFO networking_nsxv3.common.synchronization [None req-5a2e33b8-a724-4f69-9804-0ec4afa02f2e None None] Enqueued Resource ID: b847b4a8-31aa-4844-9360-b27da2200474 with Priority: HIGHEST for action port [ 619.645229] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b847b4a8-31aa-4844-9360-b27da2200474 with Priority: HIGHEST for action port [ 619.645229] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-b847b4a8-31aa-4844-9360-b27da2200474 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.645229] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b847b4a8-31aa-4844-9360-b27da2200474" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.645229] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b847b4a8-31aa-4844-9360-b27da2200474" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.645229] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b847b4a8-31aa-4844-9360-b27da2200474" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.645229] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b847b4a8-31aa-4844-9360-b27da2200474',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.795997] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.884256] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0c24dbd-a3bb-4ba7-8bd1-0206c6519816',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.885068] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.885305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.885663] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d435ef58-a090-4c51-b69d-6bafa2b6ff27 with status ACTIVE [ 619.885875] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.885989] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.886066] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.886279] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.886390] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.886528] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.886619] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.886677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.886826] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.886901] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.887095] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.887174] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.887230] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.887391] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.887448] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.887529] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d435ef58-a090-4c51-b69d-6bafa2b6ff27 is going to be updated. [ 619.908413] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.909537] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.909537] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.909537] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.909537] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.909537] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d435ef58-a090-4c51-b69d-6bafa2b6ff27" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.931155] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9546ef83-051f-4623-9fa9-0c95fc065e91 in Status: SUCCESS [ 619.931155] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9546ef83-051f-4623-9fa9-0c95fc065e91 deletion is rescheduled due to dependency. [ 619.931155] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.045503] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 00277b8e-3f38-416c-8a75-cc28d3dd5af4 [ 620.045791] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.046819] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.046819] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.046819] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.046819] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.046819] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:00277b8e-3f38-416c-8a75-cc28d3dd5af4 already deleted. [ 620.046819] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00277b8e-3f38-416c-8a75-cc28d3dd5af4" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.047371] env[70013]: INFO networking_nsxv3.common.synchronization [req-453ac8b1-c898-4f3e-919c-2a1a597f2e6d req-bcb6346e-6193-4f4a-8eec-88c52ba1502b tempest-ServerAddressesNegativeTestJSON-1327869760 tempest-ServerAddressesNegativeTestJSON-1327869760-project-member] Enqueued Resource ID: 003a4f7e-1782-4af4-a327-5a4d7c0bee4d with Priority: HIGHEST for action security_group_members [ 620.048946] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 003a4f7e-1782-4af4-a327-5a4d7c0bee4d with Priority: HIGHEST for action security_group_members [ 620.049183] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.049353] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.049446] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.049790] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.050235] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.051105] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.051775] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.052041] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.052272] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.052378] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('003a4f7e-1782-4af4-a327-5a4d7c0bee4d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.147405] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b847b4a8-31aa-4844-9360-b27da2200474 [ 620.147642] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.147776] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.147839] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.148068] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.148152] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.148272] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b847b4a8-31aa-4844-9360-b27da2200474 already deleted. [ 620.148371] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b847b4a8-31aa-4844-9360-b27da2200474" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.299468] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.299665] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.299738] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.299961] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.300069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.300168] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd is going to be created. [ 620.329158] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.329321] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.329406] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.329629] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.329815] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.339570] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd in Status: UNINITIALIZED for 2s [ 620.389091] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0c24dbd-a3bb-4ba7-8bd1-0206c6519816',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.556663] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.556941] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.556941] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.557202] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.557202] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.557400] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.557498] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.557553] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.557707] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.557796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.557882] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 003a4f7e-1782-4af4-a327-5a4d7c0bee4d already deleted. [ 620.557962] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.895479] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.895757] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.895843] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.896125] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.896236] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.896367] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 is going to be created. [ 620.922070] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.922070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.922070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.922070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.922070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.931046] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 in Status: UNINITIALIZED for 2s [ 621.011695] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-361 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.011924] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-361" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.012200] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-361" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.012414] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-361" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.012704] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.012855] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.012973] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.013219] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.013365] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.013567] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 621.013677] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 621.013781] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 621.013888] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 621.013993] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 621.014111] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 621.014316] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 621.032822] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 621.033131] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 621.033196] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 621.033372] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-361" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.033672] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-505b9f3d-c597-4acb-8477-fd64b8ea5de1 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.033840] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-505b9f3d-c597-4acb-8477-fd64b8ea5de1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.034154] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-505b9f3d-c597-4acb-8477-fd64b8ea5de1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.034286] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-505b9f3d-c597-4acb-8477-fd64b8ea5de1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.034432] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('505b9f3d-c597-4acb-8477-fd64b8ea5de1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.219908] env[70013]: INFO networking_nsxv3.common.synchronization [None req-9ff0e4da-8eab-44f1-b4c5-520e3d904d53 tempest-ServersV294TestFqdnHostnames-1836307938 tempest-ServersV294TestFqdnHostnames-1836307938-project-member] Enqueued Resource ID: e4b90d0d-893d-4d8b-9c48-77a47707807a with Priority: HIGHEST for action security_group_rules [ 621.220649] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4b90d0d-893d-4d8b-9c48-77a47707807a with Priority: HIGHEST for action security_group_rules [ 621.221113] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4b90d0d-893d-4d8b-9c48-77a47707807a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.221235] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.221344] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.221629] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.221711] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4b90d0d-893d-4d8b-9c48-77a47707807a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.312090] env[70013]: INFO networking_nsxv3.common.synchronization [None req-0abac26f-cd25-4c1b-975b-04eef16e1d24 tempest-ServersV294TestFqdnHostnames-1836307938 tempest-ServersV294TestFqdnHostnames-1836307938-project-member] Enqueued Resource ID: e4b90d0d-893d-4d8b-9c48-77a47707807a with Priority: HIGHEST for action security_group_rules [ 621.312675] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4b90d0d-893d-4d8b-9c48-77a47707807a with Priority: HIGHEST for action security_group_rules [ 621.312976] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4b90d0d-893d-4d8b-9c48-77a47707807a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.313814] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.542987] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.543234] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.543408] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.543776] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.544101] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.544298] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 505b9f3d-c597-4acb-8477-fd64b8ea5de1 not found, creating... [ 621.544593] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.544878] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.544926] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.545494] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.545494] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.545818] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.546617] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.546864] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.547221] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.547372] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.547573] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 505b9f3d-c597-4acb-8477-fd64b8ea5de1 is going to be created. [ 621.573409] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.573409] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.573409] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.573409] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.573409] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.573409] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-505b9f3d-c597-4acb-8477-fd64b8ea5de1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.723426] env[70013]: INFO networking_nsxv3.common.synchronization [req-e6990bd3-4db8-4674-976c-03439868da6d req-22112356-f45d-4600-998e-c4a29c19426f tempest-SecurityGroupRulesTestJSON-1067418828 tempest-SecurityGroupRulesTestJSON-1067418828-project-member] Enqueued Resource ID: 9d0b0865-e5de-4a72-a263-4117d35abbc6 with Priority: HIGHEST for action security_group_rules [ 621.724013] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d0b0865-e5de-4a72-a263-4117d35abbc6 with Priority: HIGHEST for action security_group_rules [ 621.725725] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d0b0865-e5de-4a72-a263-4117d35abbc6 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.729211] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d0b0865-e5de-4a72-a263-4117d35abbc6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.729211] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d0b0865-e5de-4a72-a263-4117d35abbc6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.729211] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d0b0865-e5de-4a72-a263-4117d35abbc6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.729211] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d0b0865-e5de-4a72-a263-4117d35abbc6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.745954] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.746108] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.746185] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.746408] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.746509] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.746603] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4b90d0d-893d-4d8b-9c48-77a47707807a already deleted. [ 621.746686] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.746826] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.746984] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.747079] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4b90d0d-893d-4d8b-9c48-77a47707807a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.942825] env[70013]: INFO networking_nsxv3.common.synchronization [req-29b4d9e1-169a-4b47-94a5-9dc4f659ee82 req-4135857c-0538-4d91-b342-f6c5be0e78d2 tempest-ServersTestFqdnHostnames-357486929 tempest-ServersTestFqdnHostnames-357486929-project-member] Enqueued Resource ID: 7a9726c0-7c30-4b11-81a1-9a9fcc702273 with Priority: HIGHEST for action security_group_members [ 621.943059] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a9726c0-7c30-4b11-81a1-9a9fcc702273 with Priority: HIGHEST for action security_group_members [ 621.943310] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a9726c0-7c30-4b11-81a1-9a9fcc702273 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.943442] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.943502] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.943772] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.943918] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.944354] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.944897] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.945135] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.945235] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.945382] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a9726c0-7c30-4b11-81a1-9a9fcc702273',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.227305] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-725 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.229016] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-725" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.229170] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-725" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.229525] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-725" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.229821] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.229989] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.230139] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.233615] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.233615] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.233615] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 622.233615] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 622.233615] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 622.233615] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 622.233615] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 622.233615] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 622.233615] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 622.260932] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.261217] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.261217] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.261442] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.261489] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.261606] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d0b0865-e5de-4a72-a263-4117d35abbc6 already deleted. [ 622.261748] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d0b0865-e5de-4a72-a263-4117d35abbc6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.267754] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 622.267984] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 622.268553] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 622.268553] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-725" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.268707] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-16a8d745-ea55-4e94-9513-0b5547738678 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.268882] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-16a8d745-ea55-4e94-9513-0b5547738678" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.269014] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-16a8d745-ea55-4e94-9513-0b5547738678" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.269335] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-16a8d745-ea55-4e94-9513-0b5547738678" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.269475] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16a8d745-ea55-4e94-9513-0b5547738678',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.271870] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.272024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.272088] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.272255] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.272343] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.272485] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4b90d0d-893d-4d8b-9c48-77a47707807a already deleted. [ 622.272598] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.348850] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd in Status: SUCCESS [ 622.349105] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.349620] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.350081] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.350081] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.350226] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.350392] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.350575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.350575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.350647] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.350942] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.445836] env[70013]: INFO networking_nsxv3.common.synchronization [req-453ac8b1-c898-4f3e-919c-2a1a597f2e6d req-db0122cc-736a-48c7-be81-4f8f07d45535 service nova] Enqueued Resource ID: 003a4f7e-1782-4af4-a327-5a4d7c0bee4d with Priority: HIGHEST for action security_group_rules [ 622.446016] env[70013]: INFO networking_nsxv3.common.synchronization [req-453ac8b1-c898-4f3e-919c-2a1a597f2e6d req-db0122cc-736a-48c7-be81-4f8f07d45535 service nova] Enqueued Resource ID: 003a4f7e-1782-4af4-a327-5a4d7c0bee4d with Priority: HIGHEST for action security_group_members [ 622.446253] env[70013]: INFO networking_nsxv3.common.synchronization [req-453ac8b1-c898-4f3e-919c-2a1a597f2e6d req-db0122cc-736a-48c7-be81-4f8f07d45535 service nova] Enqueued Resource ID: 505b9f3d-c597-4acb-8477-fd64b8ea5de1 with Priority: HIGHEST for action port [ 622.446400] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 003a4f7e-1782-4af4-a327-5a4d7c0bee4d with Priority: HIGHEST for action security_group_rules [ 622.446527] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 003a4f7e-1782-4af4-a327-5a4d7c0bee4d with Priority: HIGHEST for action security_group_members [ 622.446622] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 505b9f3d-c597-4acb-8477-fd64b8ea5de1 with Priority: HIGHEST for action port [ 622.447236] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-003a4f7e-1782-4af4-a327-5a4d7c0bee4d taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.447361] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.447433] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.447777] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.447777] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('003a4f7e-1782-4af4-a327-5a4d7c0bee4d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.448642] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.448758] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.448824] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.449444] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.449444] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.449444] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.449444] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.449444] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.449730] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.449730] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('003a4f7e-1782-4af4-a327-5a4d7c0bee4d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.454181] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-505b9f3d-c597-4acb-8477-fd64b8ea5de1 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.454181] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-505b9f3d-c597-4acb-8477-fd64b8ea5de1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.454181] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-505b9f3d-c597-4acb-8477-fd64b8ea5de1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.454181] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-505b9f3d-c597-4acb-8477-fd64b8ea5de1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.454181] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('505b9f3d-c597-4acb-8477-fd64b8ea5de1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.454829] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.454932] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.454996] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.455171] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.455254] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.455429] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.455530] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.455592] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.455735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.455813] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.455893] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a9726c0-7c30-4b11-81a1-9a9fcc702273 already deleted. [ 622.455972] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.529397] env[70013]: INFO networking_nsxv3.common.synchronization [None req-bf793c25-55af-4cdf-af91-1f06d04d4313 None None] Enqueued Resource ID: 98c299fb-e716-45d2-8b36-52d24b3ceb13 with Priority: HIGHEST for action port [ 622.529513] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c299fb-e716-45d2-8b36-52d24b3ceb13 with Priority: HIGHEST for action port [ 622.530254] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-98c299fb-e716-45d2-8b36-52d24b3ceb13 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.530254] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98c299fb-e716-45d2-8b36-52d24b3ceb13" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.530449] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98c299fb-e716-45d2-8b36-52d24b3ceb13" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.531758] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98c299fb-e716-45d2-8b36-52d24b3ceb13" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.531758] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98c299fb-e716-45d2-8b36-52d24b3ceb13',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.774631] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.776633] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.776862] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.777256] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.777439] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.777701] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 16a8d745-ea55-4e94-9513-0b5547738678 not found, creating... [ 622.778342] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.779181] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.779181] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.779181] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.779474] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.779780] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.780052] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.780542] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.780941] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.781222] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.781420] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 16a8d745-ea55-4e94-9513-0b5547738678 is going to be created. [ 622.807378] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.807683] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.807782] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.808100] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.808378] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.808640] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-16a8d745-ea55-4e94-9513-0b5547738678" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.853833] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.944959] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 in Status: SUCCESS [ 622.944959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.944959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.944959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.944959] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.944959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.944959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.945650] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.945650] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.945650] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.945747] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0c24dbd-a3bb-4ba7-8bd1-0206c6519816',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.958883] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('003a4f7e-1782-4af4-a327-5a4d7c0bee4d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.959926] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 505b9f3d-c597-4acb-8477-fd64b8ea5de1 with status ACTIVE [ 622.960387] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.960762] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.960762] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.960869] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.961570] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.961570] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.961570] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.961570] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.961863] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.961863] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.962199] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.962400] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.962586] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.962970] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.963460] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.963460] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 505b9f3d-c597-4acb-8477-fd64b8ea5de1 is going to be updated. [ 622.965098] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.965296] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.989118] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.989514] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.989623] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.989871] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.990104] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.990329] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-505b9f3d-c597-4acb-8477-fd64b8ea5de1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.033375] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 98c299fb-e716-45d2-8b36-52d24b3ceb13 [ 623.033667] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.033841] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.033927] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.034270] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.034363] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.034501] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:98c299fb-e716-45d2-8b36-52d24b3ceb13 already deleted. [ 623.034609] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98c299fb-e716-45d2-8b36-52d24b3ceb13" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.356513] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd: rpc.has_security_group_logging(os_id): False [ 623.374719] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.374877] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.374922] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.377103] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.377103] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.377103] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.377103] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.377103] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.377103] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.377103] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.377103] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd is going to be created. [ 623.440719] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.440719] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.440719] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.440719] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.440719] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.453018] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.453018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.453018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.453018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.453018] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.453018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.453018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.453018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.453018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.453018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.453018] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.453018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.453018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.453018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.453018] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.453018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.453732] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.453732] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.453732] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.453732] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.453732] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0c24dbd-a3bb-4ba7-8bd1-0206c6519816',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.455384] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd in Status: IN_PROGRESS for 2s [ 623.467429] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('003a4f7e-1782-4af4-a327-5a4d7c0bee4d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.500103] env[70013]: INFO networking_nsxv3.common.synchronization [req-29b4d9e1-169a-4b47-94a5-9dc4f659ee82 req-7506cc61-2171-42c5-b9d5-db695f2f4146 service nova] Enqueued Resource ID: 7a9726c0-7c30-4b11-81a1-9a9fcc702273 with Priority: HIGHEST for action security_group_rules [ 623.500103] env[70013]: INFO networking_nsxv3.common.synchronization [req-29b4d9e1-169a-4b47-94a5-9dc4f659ee82 req-7506cc61-2171-42c5-b9d5-db695f2f4146 service nova] Enqueued Resource ID: 7a9726c0-7c30-4b11-81a1-9a9fcc702273 with Priority: HIGHEST for action security_group_members [ 623.500103] env[70013]: INFO networking_nsxv3.common.synchronization [req-29b4d9e1-169a-4b47-94a5-9dc4f659ee82 req-7506cc61-2171-42c5-b9d5-db695f2f4146 service nova] Enqueued Resource ID: 16a8d745-ea55-4e94-9513-0b5547738678 with Priority: HIGHEST for action port [ 623.500103] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a9726c0-7c30-4b11-81a1-9a9fcc702273 with Priority: HIGHEST for action security_group_rules [ 623.500329] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a9726c0-7c30-4b11-81a1-9a9fcc702273 with Priority: HIGHEST for action security_group_members [ 623.500329] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16a8d745-ea55-4e94-9513-0b5547738678 with Priority: HIGHEST for action port [ 623.500575] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a9726c0-7c30-4b11-81a1-9a9fcc702273 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.500767] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.500767] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.500949] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.501040] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a9726c0-7c30-4b11-81a1-9a9fcc702273',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.501886] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a9726c0-7c30-4b11-81a1-9a9fcc702273 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.502012] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.502083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.502252] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.502401] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.502520] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.502575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.502723] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.502807] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.503841] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a9726c0-7c30-4b11-81a1-9a9fcc702273',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.503841] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-16a8d745-ea55-4e94-9513-0b5547738678 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.503841] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16a8d745-ea55-4e94-9513-0b5547738678" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.503841] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16a8d745-ea55-4e94-9513-0b5547738678" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.504145] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16a8d745-ea55-4e94-9513-0b5547738678" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.504145] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16a8d745-ea55-4e94-9513-0b5547738678',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.949213] env[70013]: INFO networking_nsxv3.common.synchronization [req-4dea167c-185a-45fd-9d89-3f9f5b413382 req-e8c7fa17-f5ca-485d-9b9d-9d728300ea44 tempest-SecurityGroupRulesTestJSON-1067418828 tempest-SecurityGroupRulesTestJSON-1067418828-project-member] Enqueued Resource ID: 9d0b0865-e5de-4a72-a263-4117d35abbc6 with Priority: HIGHEST for action security_group_rules [ 623.949785] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d0b0865-e5de-4a72-a263-4117d35abbc6 with Priority: HIGHEST for action security_group_rules [ 623.950152] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d0b0865-e5de-4a72-a263-4117d35abbc6 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.950274] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d0b0865-e5de-4a72-a263-4117d35abbc6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.950358] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d0b0865-e5de-4a72-a263-4117d35abbc6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.950565] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d0b0865-e5de-4a72-a263-4117d35abbc6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.950640] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d0b0865-e5de-4a72-a263-4117d35abbc6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.956473] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0c24dbd-a3bb-4ba7-8bd1-0206c6519816: rpc.has_security_group_logging(os_id): False [ 623.968954] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.969139] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.969209] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.969425] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.969517] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.969614] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 003a4f7e-1782-4af4-a327-5a4d7c0bee4d is going to be created. [ 623.976258] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.976429] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.976473] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.976642] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.976731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.976935] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.977093] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.977163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.977320] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.977400] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.977585] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.977674] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.977722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.977856] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.977930] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.978165] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.978272] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.978377] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.978493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.978569] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.978654] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 is going to be created. [ 623.993032] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.993301] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.993380] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.993628] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.993787] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.003355] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 003a4f7e-1782-4af4-a327-5a4d7c0bee4d in Status: UNINITIALIZED for 2s [ 624.005645] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a9726c0-7c30-4b11-81a1-9a9fcc702273',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.006637] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a9726c0-7c30-4b11-81a1-9a9fcc702273 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.006711] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.006830] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16a8d745-ea55-4e94-9513-0b5547738678 with status ACTIVE [ 624.007000] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.007177] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.007215] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.007415] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.007489] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.007640] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.007740] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.007803] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.007960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.008052] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.008594] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.008594] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.008594] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.008735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.008735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.008794] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16a8d745-ea55-4e94-9513-0b5547738678 is going to be updated. [ 624.048616] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.048784] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.048854] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.049093] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.049240] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.049416] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16a8d745-ea55-4e94-9513-0b5547738678" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.059736] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.059736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.059736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.059736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.059736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.081867] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 in Status: IN_PROGRESS for 2s [ 624.474163] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.474322] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.474392] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.474606] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.474699] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.474796] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d0b0865-e5de-4a72-a263-4117d35abbc6 already deleted. [ 624.474877] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d0b0865-e5de-4a72-a263-4117d35abbc6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.511542] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a9726c0-7c30-4b11-81a1-9a9fcc702273',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.597226] env[70013]: INFO networking_nsxv3.common.synchronization [req-56a05712-2a83-4478-8108-9aa3f860e593 req-c2e097d9-921e-4d94-a428-8ac722a90571 tempest-FloatingIPsAssociationTestJSON-1070439366 tempest-FloatingIPsAssociationTestJSON-1070439366-project-member] Enqueued Resource ID: ff280f19-627b-45ca-afac-7d9154581e89 with Priority: HIGHEST for action security_group_members [ 624.598149] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff280f19-627b-45ca-afac-7d9154581e89 with Priority: HIGHEST for action security_group_members [ 624.598149] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff280f19-627b-45ca-afac-7d9154581e89 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.598332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.598332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.598640] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.598829] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.598957] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.599068] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.599356] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.599471] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.599672] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff280f19-627b-45ca-afac-7d9154581e89',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.014501] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.014501] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.014859] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.014859] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.016248] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.018142] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a9726c0-7c30-4b11-81a1-9a9fcc702273 is going to be created. [ 625.043073] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.047259] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.047339] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.047560] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.047730] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.056069] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a9726c0-7c30-4b11-81a1-9a9fcc702273 in Status: UNINITIALIZED for 2s [ 625.102808] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.102991] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.103092] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.103321] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.103785] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.103785] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.103785] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.103983] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.104261] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.104261] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.104356] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff280f19-627b-45ca-afac-7d9154581e89 already deleted. [ 625.104467] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.113019] env[70013]: INFO networking_nsxv3.common.synchronization [req-913786dc-d745-4d54-a251-6dc9c1a60ea9 req-05f3d04e-df53-48dd-b579-8eaccfd4f3e9 tempest-DeleteServersAdminTestJSON-409072902 tempest-DeleteServersAdminTestJSON-409072902-project-admin] Enqueued Resource ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 with Priority: HIGHEST for action security_group_members [ 625.113300] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 with Priority: HIGHEST for action security_group_members [ 625.113861] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16fadac6-f5a2-4997-b67b-221b3b4e45a8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.114169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.114169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.114295] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.114382] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.114519] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.114616] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.114778] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.114898] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.114991] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16fadac6-f5a2-4997-b67b-221b3b4e45a8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.171343] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-177 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.171617] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-177" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.171617] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-177" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.172117] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-177" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.172282] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.172390] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.172426] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.173292] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.173292] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.173292] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 625.173292] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 625.173419] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 625.173509] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 625.173570] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 625.173683] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 625.173818] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 625.203080] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 625.203080] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 625.203080] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 625.203080] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-177" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.203080] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-4e709a63-45c3-48e8-8762-26e149c61266 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.203080] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-4e709a63-45c3-48e8-8762-26e149c61266" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.203080] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-4e709a63-45c3-48e8-8762-26e149c61266" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.203080] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-4e709a63-45c3-48e8-8762-26e149c61266" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.203080] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e709a63-45c3-48e8-8762-26e149c61266',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.467102] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd in Status: SUCCESS [ 625.467375] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.617127] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.617335] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.617398] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.617576] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.617741] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.617852] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.618032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.618086] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.618227] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.618301] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.618390] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 is going to be updated. [ 625.645348] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.645496] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.645564] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.645769] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.645910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.654144] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 in Status: IN_PROGRESS for 2s [ 625.705327] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.705584] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.705706] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.705978] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.706140] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.706293] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 4e709a63-45c3-48e8-8762-26e149c61266 not found, creating... [ 625.706548] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.706700] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.706816] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.707058] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.707253] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.707561] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.707956] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.708092] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.708328] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.708470] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.708614] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 4e709a63-45c3-48e8-8762-26e149c61266 is going to be created. [ 625.728635] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.728635] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.728635] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.728900] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.729115] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.729334] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-4e709a63-45c3-48e8-8762-26e149c61266" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.012808] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 003a4f7e-1782-4af4-a327-5a4d7c0bee4d in Status: SUCCESS [ 626.012888] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.013026] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.013272] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.013482] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.013637] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.013691] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.013811] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.013889] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.013975] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.014124] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('003a4f7e-1782-4af4-a327-5a4d7c0bee4d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.096466] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 in Status: SUCCESS [ 626.096466] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.509034] env[70013]: INFO networking_nsxv3.common.synchronization [req-56a05712-2a83-4478-8108-9aa3f860e593 req-0f69c3bb-1aa2-4073-a158-552fc0ba6ebc service nova] Enqueued Resource ID: ff280f19-627b-45ca-afac-7d9154581e89 with Priority: HIGHEST for action security_group_rules [ 626.509034] env[70013]: INFO networking_nsxv3.common.synchronization [req-56a05712-2a83-4478-8108-9aa3f860e593 req-0f69c3bb-1aa2-4073-a158-552fc0ba6ebc service nova] Enqueued Resource ID: ff280f19-627b-45ca-afac-7d9154581e89 with Priority: HIGHEST for action security_group_members [ 626.509034] env[70013]: INFO networking_nsxv3.common.synchronization [req-56a05712-2a83-4478-8108-9aa3f860e593 req-0f69c3bb-1aa2-4073-a158-552fc0ba6ebc service nova] Enqueued Resource ID: 4e709a63-45c3-48e8-8762-26e149c61266 with Priority: HIGHEST for action port [ 626.509299] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff280f19-627b-45ca-afac-7d9154581e89 with Priority: HIGHEST for action security_group_rules [ 626.509432] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff280f19-627b-45ca-afac-7d9154581e89 with Priority: HIGHEST for action security_group_members [ 626.509520] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e709a63-45c3-48e8-8762-26e149c61266 with Priority: HIGHEST for action port [ 626.512869] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff280f19-627b-45ca-afac-7d9154581e89 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.512869] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.512869] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.512869] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.513151] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff280f19-627b-45ca-afac-7d9154581e89',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.514614] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff280f19-627b-45ca-afac-7d9154581e89 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.514614] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.514614] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.514982] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.514982] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.515255] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.515255] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.515587] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.515587] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.515587] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff280f19-627b-45ca-afac-7d9154581e89',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.518665] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e709a63-45c3-48e8-8762-26e149c61266 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.518665] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e709a63-45c3-48e8-8762-26e149c61266" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.518773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e709a63-45c3-48e8-8762-26e149c61266" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.518987] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e709a63-45c3-48e8-8762-26e149c61266" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.519165] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e709a63-45c3-48e8-8762-26e149c61266',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.521568] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.521827] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.521827] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.522048] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.522617] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.522617] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.522617] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.522883] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.522883] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.522883] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.523132] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.523221] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.523221] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.523382] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.523512] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.523664] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.523664] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.523761] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.523841] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.523933] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.524394] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('003a4f7e-1782-4af4-a327-5a4d7c0bee4d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.016037] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff280f19-627b-45ca-afac-7d9154581e89 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.016037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.021084] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff280f19-627b-45ca-afac-7d9154581e89',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.024832] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e709a63-45c3-48e8-8762-26e149c61266 with status ACTIVE [ 627.024832] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.024832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.024832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.024832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.024832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.024832] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.024832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.024832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.024832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.024832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.024832] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.024832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.024832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.024832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.024832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.024832] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e709a63-45c3-48e8-8762-26e149c61266 is going to be updated. [ 627.026649] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 003a4f7e-1782-4af4-a327-5a4d7c0bee4d: rpc.has_security_group_logging(os_id): False [ 627.048449] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.048607] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.048675] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.048880] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.049027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.049186] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e709a63-45c3-48e8-8762-26e149c61266" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.050103] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.050205] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.050253] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.050457] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.050538] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.050724] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.050835] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.050922] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.050996] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.054348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.054484] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.054566] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.054635] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.054791] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.054873] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.055090] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.055305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.055305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.055413] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.055501] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.055582] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 003a4f7e-1782-4af4-a327-5a4d7c0bee4d is going to be created. [ 627.064773] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a9726c0-7c30-4b11-81a1-9a9fcc702273 in Status: SUCCESS [ 627.064980] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.065152] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.065353] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.065539] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.065652] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.065716] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.065874] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.065967] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.066191] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.066191] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a9726c0-7c30-4b11-81a1-9a9fcc702273',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.111057] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.111400] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.111400] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.111626] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.111810] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.124051] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 003a4f7e-1782-4af4-a327-5a4d7c0bee4d in Status: IN_PROGRESS for 2s [ 627.155581] env[70013]: INFO networking_nsxv3.common.synchronization [req-19f006fc-5c22-4019-ba7c-b83df5a03cea req-7ad6ebe3-58bf-499a-a471-798bfd0d689e tempest-ServersAdminTestJSON-1183835690 tempest-ServersAdminTestJSON-1183835690-project-member] Enqueued Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_members [ 627.156119] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_members [ 627.156471] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7abade-e912-4196-b558-4a6d4ece9b29 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.156594] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.156825] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.156984] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.158166] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.158166] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.159738] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.159969] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.160275] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.160434] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.521967] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff280f19-627b-45ca-afac-7d9154581e89',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.570144] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a9726c0-7c30-4b11-81a1-9a9fcc702273',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.661493] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-713 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.661736] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-713" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.661827] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-713" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.662190] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-713" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.662464] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.662625] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.662731] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.662988] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.663902] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.664158] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 627.664296] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 627.664385] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 627.664511] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 627.664615] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 627.664721] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 627.664854] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 627.666955] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 in Status: SUCCESS [ 627.670995] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 deletion is rescheduled due to dependency. [ 627.671109] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.671828] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.671942] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.672011] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.672403] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.672403] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.672494] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.672621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.672621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.672803] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.672883] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.672967] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 already deleted. [ 627.673056] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.688599] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 627.688788] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 627.688949] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 627.689183] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-713" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.689560] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-6348da2f-b0bd-499f-bf5e-b14a38d29438 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.689839] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-6348da2f-b0bd-499f-bf5e-b14a38d29438" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.690068] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-6348da2f-b0bd-499f-bf5e-b14a38d29438" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.690530] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-6348da2f-b0bd-499f-bf5e-b14a38d29438" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.690737] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6348da2f-b0bd-499f-bf5e-b14a38d29438',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.027728] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.027880] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.027953] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.028270] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.028341] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.028454] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff280f19-627b-45ca-afac-7d9154581e89 is going to be created. [ 628.031548] env[70013]: INFO networking_nsxv3.common.synchronization [req-2267e179-901e-4afd-b06f-f554c1ce8d06 req-9e526668-b3ac-4c14-9560-5d4a4d1cd8ea tempest-SecurityGroupRulesTestJSON-1067418828 tempest-SecurityGroupRulesTestJSON-1067418828-project-member] Enqueued Resource ID: 9d0b0865-e5de-4a72-a263-4117d35abbc6 with Priority: HIGHEST for action security_group_rules [ 628.032136] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d0b0865-e5de-4a72-a263-4117d35abbc6 with Priority: HIGHEST for action security_group_rules [ 628.032890] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d0b0865-e5de-4a72-a263-4117d35abbc6 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.033024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d0b0865-e5de-4a72-a263-4117d35abbc6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.033170] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d0b0865-e5de-4a72-a263-4117d35abbc6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.033395] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d0b0865-e5de-4a72-a263-4117d35abbc6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.033430] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d0b0865-e5de-4a72-a263-4117d35abbc6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.067399] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.067559] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.067629] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.067883] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.068014] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.072682] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a9726c0-7c30-4b11-81a1-9a9fcc702273: rpc.has_security_group_logging(os_id): False [ 628.083463] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff280f19-627b-45ca-afac-7d9154581e89 in Status: UNINITIALIZED for 2s [ 628.098428] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.101637] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.101637] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.101637] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.101637] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.101637] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.101637] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.101637] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.101637] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.101637] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.101637] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a9726c0-7c30-4b11-81a1-9a9fcc702273 is going to be created. [ 628.167275] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.167609] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.167609] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.168529] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.168529] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.178487] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a9726c0-7c30-4b11-81a1-9a9fcc702273 in Status: IN_PROGRESS for 2s [ 628.194035] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.194279] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.194407] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.194704] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.194846] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.194999] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 6348da2f-b0bd-499f-bf5e-b14a38d29438 not found, creating... [ 628.195315] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.195468] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.195578] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.195794] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.195922] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.196216] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.196375] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.197823] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.197823] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.197823] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.197823] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 6348da2f-b0bd-499f-bf5e-b14a38d29438 is going to be created. [ 628.225415] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.225569] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.226709] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.227082] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.227324] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.227547] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-6348da2f-b0bd-499f-bf5e-b14a38d29438" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.563801] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.563984] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.564043] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.564277] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.564363] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.564458] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d0b0865-e5de-4a72-a263-4117d35abbc6 already deleted. [ 628.564576] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d0b0865-e5de-4a72-a263-4117d35abbc6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.840774] env[70013]: INFO networking_nsxv3.common.synchronization [None req-538aad4c-2407-46bf-9279-dcec80826fc2 tempest-ServersWithSpecificFlavorTestJSON-1827464871 tempest-ServersWithSpecificFlavorTestJSON-1827464871-project-member] Enqueued Resource ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 with Priority: HIGHEST for action security_group_rules [ 628.842820] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 with Priority: HIGHEST for action security_group_rules [ 628.843242] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.843385] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.843452] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.843730] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.843892] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.138059] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 003a4f7e-1782-4af4-a327-5a4d7c0bee4d in Status: SUCCESS [ 629.138320] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.356941] env[70013]: INFO networking_nsxv3.common.synchronization [None req-2e8867bd-b107-4d5c-b6a2-c01fb0737335 tempest-ServersWithSpecificFlavorTestJSON-1827464871 tempest-ServersWithSpecificFlavorTestJSON-1827464871-project-member] Enqueued Resource ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 with Priority: HIGHEST for action security_group_rules [ 629.356941] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 with Priority: HIGHEST for action security_group_rules [ 629.356941] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.356941] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.370138] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.370310] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.370417] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.370597] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.370684] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.370776] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 already deleted. [ 629.370880] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.370999] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.371169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.371247] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.833836] env[70013]: INFO networking_nsxv3.common.synchronization [req-19f006fc-5c22-4019-ba7c-b83df5a03cea req-f50344a0-ff4d-497c-8c51-e5446cb26ac6 service nova] Enqueued Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_rules [ 629.833955] env[70013]: INFO networking_nsxv3.common.synchronization [req-19f006fc-5c22-4019-ba7c-b83df5a03cea req-f50344a0-ff4d-497c-8c51-e5446cb26ac6 service nova] Enqueued Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_members [ 629.834095] env[70013]: INFO networking_nsxv3.common.synchronization [req-19f006fc-5c22-4019-ba7c-b83df5a03cea req-f50344a0-ff4d-497c-8c51-e5446cb26ac6 service nova] Enqueued Resource ID: 6348da2f-b0bd-499f-bf5e-b14a38d29438 with Priority: HIGHEST for action port [ 629.834322] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_rules [ 629.834453] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_members [ 629.834562] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6348da2f-b0bd-499f-bf5e-b14a38d29438 with Priority: HIGHEST for action port [ 629.835330] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a7abade-e912-4196-b558-4a6d4ece9b29 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.835469] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.835555] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.835832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.835924] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.836754] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7abade-e912-4196-b558-4a6d4ece9b29 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.836861] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.836929] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.837106] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.837250] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.837373] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.837487] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.837841] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.837935] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.838036] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.838777] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-6348da2f-b0bd-499f-bf5e-b14a38d29438 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.838899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6348da2f-b0bd-499f-bf5e-b14a38d29438" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.839052] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6348da2f-b0bd-499f-bf5e-b14a38d29438" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.839106] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6348da2f-b0bd-499f-bf5e-b14a38d29438" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.839210] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6348da2f-b0bd-499f-bf5e-b14a38d29438',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.892854] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.893059] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.893134] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.893349] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.893468] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.893624] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 already deleted. [ 629.893767] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.068257] env[70013]: INFO networking_nsxv3.common.synchronization [None req-309baff8-11e8-4ad3-be34-51c265d96c8f None None] Enqueued Resource ID: 9f2859da-1463-4855-9b92-ecd51b463ff3 with Priority: HIGHEST for action port [ 630.068558] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f2859da-1463-4855-9b92-ecd51b463ff3 with Priority: HIGHEST for action port [ 630.069116] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f2859da-1463-4855-9b92-ecd51b463ff3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.069243] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f2859da-1463-4855-9b92-ecd51b463ff3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.069333] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f2859da-1463-4855-9b92-ecd51b463ff3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.069597] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f2859da-1463-4855-9b92-ecd51b463ff3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.069709] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f2859da-1463-4855-9b92-ecd51b463ff3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.095278] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff280f19-627b-45ca-afac-7d9154581e89 in Status: SUCCESS [ 630.095737] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.095737] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.095954] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.096160] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.096305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.096484] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.098764] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.098764] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.098764] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.098764] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ff280f19-627b-45ca-afac-7d9154581e89',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.191234] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a9726c0-7c30-4b11-81a1-9a9fcc702273 in Status: SUCCESS [ 630.191650] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.341094] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.345020] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7abade-e912-4196-b558-4a6d4ece9b29 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.345020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.345020] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6348da2f-b0bd-499f-bf5e-b14a38d29438 with status ACTIVE [ 630.345020] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.345020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.345020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.345020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.345020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.345020] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.345020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.345020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.345020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.345020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.345020] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.345981] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.345981] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.345981] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.346567] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.346689] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6348da2f-b0bd-499f-bf5e-b14a38d29438 is going to be updated. [ 630.368771] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.368771] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.368771] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.368771] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.368771] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.369302] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6348da2f-b0bd-499f-bf5e-b14a38d29438" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.579493] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9f2859da-1463-4855-9b92-ecd51b463ff3 [ 630.581417] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.581417] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.581417] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.581417] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.581417] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.581417] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9f2859da-1463-4855-9b92-ecd51b463ff3 already deleted. [ 630.581417] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f2859da-1463-4855-9b92-ecd51b463ff3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.599691] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff280f19-627b-45ca-afac-7d9154581e89 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.600014] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.600156] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.600454] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.600786] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.600922] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.601024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.601202] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.601340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.601528] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.601803] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff280f19-627b-45ca-afac-7d9154581e89 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.602373] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.602548] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.602771] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.602935] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.603082] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.603120] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.603283] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.603360] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.603440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.603744] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ff280f19-627b-45ca-afac-7d9154581e89',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.849883] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.978573] env[70013]: INFO networking_nsxv3.common.synchronization [None req-51d66854-3470-4a15-945b-8a9721f87a9d None None] Enqueued Resource ID: c14c5abb-bb4a-4179-a509-18ce5583d36d with Priority: HIGHEST for action port [ 630.979144] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c14c5abb-bb4a-4179-a509-18ce5583d36d with Priority: HIGHEST for action port [ 630.980272] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-c14c5abb-bb4a-4179-a509-18ce5583d36d taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.980272] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c14c5abb-bb4a-4179-a509-18ce5583d36d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.980272] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c14c5abb-bb4a-4179-a509-18ce5583d36d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.982381] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c14c5abb-bb4a-4179-a509-18ce5583d36d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.982520] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c14c5abb-bb4a-4179-a509-18ce5583d36d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.108572] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ff280f19-627b-45ca-afac-7d9154581e89: rpc.has_security_group_logging(os_id): False [ 631.130686] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.130892] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.130985] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.131257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.131346] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.131594] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.131750] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.131950] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.132232] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.132323] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.132564] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.132746] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.132804] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.132984] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.133773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.134132] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.134333] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.134732] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.135032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.135244] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.135392] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff280f19-627b-45ca-afac-7d9154581e89 is going to be created. [ 631.190957] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.190957] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.190957] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.191606] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.191953] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.204075] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff280f19-627b-45ca-afac-7d9154581e89 in Status: IN_PROGRESS for 2s [ 631.352249] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.352549] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.352877] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.352995] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.353137] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.353288] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 is going to be created. [ 631.411734] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.412054] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.412054] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.412363] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.413758] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.427791] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: UNINITIALIZED for 2s [ 631.484337] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c14c5abb-bb4a-4179-a509-18ce5583d36d [ 631.484593] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.484733] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.484803] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.485039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.485135] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.485237] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c14c5abb-bb4a-4179-a509-18ce5583d36d already deleted. [ 631.485346] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c14c5abb-bb4a-4179-a509-18ce5583d36d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.220149] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff280f19-627b-45ca-afac-7d9154581e89 in Status: SUCCESS [ 633.220149] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.438833] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: SUCCESS [ 633.440506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.440506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.440506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.440506] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.440506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.440506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.441058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.441058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.441058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.441058] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.671639] env[70013]: INFO networking_nsxv3.common.synchronization [req-9c4176dc-f518-4259-a1fc-d3599d3288dd req-d4a42ab3-b004-46dc-a0dd-04bc4cdcce56 tempest-ServersAdminTestJSON-1183835690 tempest-ServersAdminTestJSON-1183835690-project-member] Enqueued Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_members [ 633.671639] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_members [ 633.671639] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7abade-e912-4196-b558-4a6d4ece9b29 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.671639] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.671639] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.671639] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.671639] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.671639] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.671639] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.672110] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.672110] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.672110] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.945312] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7abade-e912-4196-b558-4a6d4ece9b29 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.945492] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.174425] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.190251] env[70013]: INFO networking_nsxv3.common.synchronization [None req-2cb93cad-1e6c-4b82-ad75-b035211875d2 None None] Enqueued Resource ID: bce91673-f1c3-4ebc-9199-f9034212d81c with Priority: HIGHEST for action port [ 634.190251] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bce91673-f1c3-4ebc-9199-f9034212d81c with Priority: HIGHEST for action port [ 634.190251] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-bce91673-f1c3-4ebc-9199-f9034212d81c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.190251] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bce91673-f1c3-4ebc-9199-f9034212d81c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.190251] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bce91673-f1c3-4ebc-9199-f9034212d81c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.191223] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bce91673-f1c3-4ebc-9199-f9034212d81c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.191500] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bce91673-f1c3-4ebc-9199-f9034212d81c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.678484] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.696640] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bce91673-f1c3-4ebc-9199-f9034212d81c [ 634.696920] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.697371] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.697541] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.697825] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.697984] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.698126] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bce91673-f1c3-4ebc-9199-f9034212d81c already deleted. [ 634.698268] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bce91673-f1c3-4ebc-9199-f9034212d81c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.027569] env[70013]: INFO networking_nsxv3.common.synchronization [None req-8ac01db9-7d46-4fe5-b72e-ea5982dd7fcf None None] Enqueued Resource ID: e667b0e4-c6e9-4488-a7c9-d1b328e6464a with Priority: HIGHEST for action port [ 635.027569] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e667b0e4-c6e9-4488-a7c9-d1b328e6464a with Priority: HIGHEST for action port [ 635.028078] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-e667b0e4-c6e9-4488-a7c9-d1b328e6464a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.028078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e667b0e4-c6e9-4488-a7c9-d1b328e6464a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.028078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e667b0e4-c6e9-4488-a7c9-d1b328e6464a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.028864] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e667b0e4-c6e9-4488-a7c9-d1b328e6464a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.028975] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e667b0e4-c6e9-4488-a7c9-d1b328e6464a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.168777] env[70013]: INFO networking_nsxv3.common.synchronization [req-29be6e3d-93fd-4418-afca-2b1b9e68ad85 req-18894905-86c0-4ea4-9e2d-02498d5801eb tempest-InstanceActionsNegativeTestJSON-1332608593 tempest-InstanceActionsNegativeTestJSON-1332608593-project-member] Enqueued Resource ID: c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 with Priority: HIGHEST for action security_group_members [ 635.168777] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 with Priority: HIGHEST for action security_group_members [ 635.169049] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.169407] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.169562] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.170216] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.170216] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.170216] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.170216] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.170456] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.170456] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.170456] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0c24dbd-a3bb-4ba7-8bd1-0206c6519816',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.183188] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.183341] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.183558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.183659] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.183753] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.185304] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 is going to be updated. [ 635.211018] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.211241] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.211241] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.211411] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.211576] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.220306] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: IN_PROGRESS for 2s [ 635.462202] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-713 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.462397] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-713" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.462397] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-713" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.462793] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-713" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.462898] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.463689] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.463689] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.463821] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.465031] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.465031] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 635.465031] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 635.465031] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 635.465031] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 635.465031] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 635.465031] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 635.465031] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 635.483570] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 635.483570] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 635.483570] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 635.483872] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-713" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.484492] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-063f2ba9-4e54-4d7e-9771-1defdefc3c00 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.484492] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-063f2ba9-4e54-4d7e-9771-1defdefc3c00" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.484621] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-063f2ba9-4e54-4d7e-9771-1defdefc3c00" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.485112] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-063f2ba9-4e54-4d7e-9771-1defdefc3c00" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.485204] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('063f2ba9-4e54-4d7e-9771-1defdefc3c00',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.534450] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e667b0e4-c6e9-4488-a7c9-d1b328e6464a [ 635.534800] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.534969] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.539195] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.539375] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.539573] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.539810] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e667b0e4-c6e9-4488-a7c9-d1b328e6464a already deleted. [ 635.540225] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e667b0e4-c6e9-4488-a7c9-d1b328e6464a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.674506] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.674662] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.674777] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.675008] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.675108] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.675314] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.675413] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.675475] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.675629] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.675705] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.675791] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 is going to be updated. [ 635.703232] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.703691] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.703691] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.703691] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.706038] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.714724] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 in Status: IN_PROGRESS for 2s [ 635.989243] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.989435] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.989541] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.989848] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.990016] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.990206] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 063f2ba9-4e54-4d7e-9771-1defdefc3c00 not found, creating... [ 635.990670] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.990888] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.991038] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.991311] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.992129] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.992543] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.992855] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.993844] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.994192] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.994428] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.994651] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 063f2ba9-4e54-4d7e-9771-1defdefc3c00 is going to be created. [ 636.016945] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.017358] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.017508] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.017802] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.018038] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.018261] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-063f2ba9-4e54-4d7e-9771-1defdefc3c00" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.228953] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: SUCCESS [ 637.229280] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.229356] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.229570] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.229764] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.229883] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.229951] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.230122] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.230204] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.230289] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.230505] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7abade-e912-4196-b558-4a6d4ece9b29 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.230610] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.230680] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.230865] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.231062] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.231221] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.231221] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.231375] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.231454] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.231586] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.231684] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.300020] env[70013]: INFO networking_nsxv3.common.synchronization [req-c97c03ca-1fd6-4eb1-b865-cbf44d1f2ba4 req-25b59709-578f-4c28-a227-5d60b6c00a36 tempest-ImagesOneServerTestJSON-841575098 tempest-ImagesOneServerTestJSON-841575098-project-member] Enqueued Resource ID: d189cef5-279a-45d3-a52a-a0fb084ee3fa with Priority: HIGHEST for action security_group_members [ 637.300742] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d189cef5-279a-45d3-a52a-a0fb084ee3fa with Priority: HIGHEST for action security_group_members [ 637.301320] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d189cef5-279a-45d3-a52a-a0fb084ee3fa taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.301574] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.301669] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.302501] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.302702] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.302845] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.303013] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.303432] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.303432] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.303544] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d189cef5-279a-45d3-a52a-a0fb084ee3fa',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.726773] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 in Status: SUCCESS [ 637.726773] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 deletion is rescheduled due to dependency. [ 637.726773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.733965] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a7abade-e912-4196-b558-4a6d4ece9b29: rpc.has_security_group_logging(os_id): False [ 637.751091] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.751091] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.751091] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.751238] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.751269] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.752029] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.752029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.752029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.752029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.752029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.752282] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.752282] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.752358] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.752557] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.752686] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.753355] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.753452] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.753747] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.753747] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.753810] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.753979] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 is going to be created. [ 637.807288] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.807288] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.807288] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.807288] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.807540] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.807666] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.807666] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.807800] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.807861] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.808119] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.808119] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d189cef5-279a-45d3-a52a-a0fb084ee3fa already deleted. [ 637.808119] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.819833] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.819833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.820056] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.820261] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.820336] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.838917] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: IN_PROGRESS for 2s [ 637.868826] env[70013]: INFO networking_nsxv3.common.synchronization [req-9c4176dc-f518-4259-a1fc-d3599d3288dd req-72328def-c390-4523-a160-b894243f503f service nova] Enqueued Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_rules [ 637.868826] env[70013]: INFO networking_nsxv3.common.synchronization [req-9c4176dc-f518-4259-a1fc-d3599d3288dd req-72328def-c390-4523-a160-b894243f503f service nova] Enqueued Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_members [ 637.868826] env[70013]: INFO networking_nsxv3.common.synchronization [req-9c4176dc-f518-4259-a1fc-d3599d3288dd req-72328def-c390-4523-a160-b894243f503f service nova] Enqueued Resource ID: 063f2ba9-4e54-4d7e-9771-1defdefc3c00 with Priority: HIGHEST for action port [ 637.869675] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_rules [ 637.869675] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_members [ 637.869675] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 063f2ba9-4e54-4d7e-9771-1defdefc3c00 with Priority: HIGHEST for action port [ 637.869859] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a7abade-e912-4196-b558-4a6d4ece9b29 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.869969] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.870188] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7abade-e912-4196-b558-4a6d4ece9b29 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.872321] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.872321] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.872321] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.872321] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.872321] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.872321] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.872321] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.872321] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.873671] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.873671] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-063f2ba9-4e54-4d7e-9771-1defdefc3c00 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.873671] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-063f2ba9-4e54-4d7e-9771-1defdefc3c00" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.873671] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-063f2ba9-4e54-4d7e-9771-1defdefc3c00" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.873671] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-063f2ba9-4e54-4d7e-9771-1defdefc3c00" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.873953] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('063f2ba9-4e54-4d7e-9771-1defdefc3c00',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.015876] env[70013]: INFO networking_nsxv3.common.synchronization [None req-2ce34547-de9f-4b42-8a6c-f99414cc4555 None None] Enqueued Resource ID: f1cfb9e6-78da-4524-af79-0eac1fd5c480 with Priority: HIGHEST for action port [ 638.016527] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1cfb9e6-78da-4524-af79-0eac1fd5c480 with Priority: HIGHEST for action port [ 638.017254] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1cfb9e6-78da-4524-af79-0eac1fd5c480 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.017533] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1cfb9e6-78da-4524-af79-0eac1fd5c480" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.017636] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1cfb9e6-78da-4524-af79-0eac1fd5c480" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.017956] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1cfb9e6-78da-4524-af79-0eac1fd5c480" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.018159] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1cfb9e6-78da-4524-af79-0eac1fd5c480',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.376810] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.378041] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 063f2ba9-4e54-4d7e-9771-1defdefc3c00 with status ACTIVE [ 638.378513] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.380027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.380027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.380027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.380027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.380027] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.380027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.380027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.382306] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.382306] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.382306] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.382306] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.382306] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.382306] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.382847] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.383146] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 063f2ba9-4e54-4d7e-9771-1defdefc3c00 is going to be updated. [ 638.407755] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.407929] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.408027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.408305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.408799] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.408921] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-063f2ba9-4e54-4d7e-9771-1defdefc3c00" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.448953] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-238 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.448953] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-238" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.448953] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-238" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.451464] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-238" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.452155] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.452155] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.452155] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.453691] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.453691] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.453691] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 638.453691] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 638.453691] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 638.453691] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 638.453691] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 638.454053] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 638.455288] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 638.474755] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 638.474755] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 638.474755] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 638.474991] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-238" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.475244] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-1e8309fb-0a16-407f-9be0-abcac22185ff taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.475428] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-1e8309fb-0a16-407f-9be0-abcac22185ff" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.475554] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-1e8309fb-0a16-407f-9be0-abcac22185ff" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.475903] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-1e8309fb-0a16-407f-9be0-abcac22185ff" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.476231] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e8309fb-0a16-407f-9be0-abcac22185ff',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.521469] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1cfb9e6-78da-4524-af79-0eac1fd5c480 [ 638.521621] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.521727] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.521808] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.522406] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.522406] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.522406] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1cfb9e6-78da-4524-af79-0eac1fd5c480 already deleted. [ 638.522406] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1cfb9e6-78da-4524-af79-0eac1fd5c480" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.879195] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.983504] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.983504] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.983504] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.983504] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.983504] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.983504] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 1e8309fb-0a16-407f-9be0-abcac22185ff not found, creating... [ 638.983504] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.983504] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.983504] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.983504] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.983504] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.984045] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.984045] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.984045] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.985453] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.985453] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.985453] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 1e8309fb-0a16-407f-9be0-abcac22185ff is going to be created. [ 639.006227] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.006330] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.006384] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.006717] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.007408] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.007408] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-1e8309fb-0a16-407f-9be0-abcac22185ff" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.384474] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.384474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.384474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.384474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.384474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.384474] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 is going to be updated. [ 639.414682] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.414682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.414682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.414682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.414682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.426575] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: IN_PROGRESS for 2s [ 639.489984] env[70013]: INFO networking_nsxv3.common.synchronization [None req-0beff5fc-dd33-4d2e-8679-fd6d142e9402 None None] Enqueued Resource ID: 60501ad7-1910-4adb-a3a6-1558ac0107fc with Priority: HIGHEST for action port [ 639.490329] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60501ad7-1910-4adb-a3a6-1558ac0107fc with Priority: HIGHEST for action port [ 639.490771] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-60501ad7-1910-4adb-a3a6-1558ac0107fc taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.491955] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60501ad7-1910-4adb-a3a6-1558ac0107fc" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.491955] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60501ad7-1910-4adb-a3a6-1558ac0107fc" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.491955] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60501ad7-1910-4adb-a3a6-1558ac0107fc" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.491955] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60501ad7-1910-4adb-a3a6-1558ac0107fc',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.639938] env[70013]: INFO networking_nsxv3.common.synchronization [None req-6ef6f0d6-01ad-49b5-b8c6-1dcda2c3bb63 None None] Enqueued Resource ID: 6bcdfd5c-dedd-49c1-92f0-34d66c8857fd with Priority: HIGHEST for action port [ 639.640590] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bcdfd5c-dedd-49c1-92f0-34d66c8857fd with Priority: HIGHEST for action port [ 639.641728] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bcdfd5c-dedd-49c1-92f0-34d66c8857fd taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.643875] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bcdfd5c-dedd-49c1-92f0-34d66c8857fd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.643875] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bcdfd5c-dedd-49c1-92f0-34d66c8857fd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.643875] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bcdfd5c-dedd-49c1-92f0-34d66c8857fd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.643875] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bcdfd5c-dedd-49c1-92f0-34d66c8857fd',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.736980] env[70013]: INFO networking_nsxv3.common.synchronization [req-ca971112-1fdc-43e1-a08f-4a2ce10df748 req-1a2babb3-be2f-4005-8383-40a9dd00852f tempest-AttachVolumeTestJSON-972861423 tempest-AttachVolumeTestJSON-972861423-project-member] Enqueued Resource ID: 5333cddc-c089-40b3-9eba-dc3f40477cac with Priority: HIGHEST for action security_group_members [ 639.737724] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5333cddc-c089-40b3-9eba-dc3f40477cac with Priority: HIGHEST for action security_group_members [ 639.738950] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5333cddc-c089-40b3-9eba-dc3f40477cac taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.739217] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.739259] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.740320] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.740320] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.740320] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.740320] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.740569] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.741037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.741217] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5333cddc-c089-40b3-9eba-dc3f40477cac',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.852730] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: SUCCESS [ 639.853785] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.853980] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.854524] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.854623] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.992934] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60501ad7-1910-4adb-a3a6-1558ac0107fc [ 639.994229] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.994229] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.994229] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.994369] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.994369] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.994484] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60501ad7-1910-4adb-a3a6-1558ac0107fc already deleted. [ 639.994566] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60501ad7-1910-4adb-a3a6-1558ac0107fc" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.070331] env[70013]: INFO networking_nsxv3.common.synchronization [None req-de4e89b6-d7f2-4a8c-9023-8d9758f0479c None None] Enqueued Resource ID: 4347b86b-bfad-440b-95fc-b43253bc9938 with Priority: HIGHEST for action port [ 640.070331] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4347b86b-bfad-440b-95fc-b43253bc9938 with Priority: HIGHEST for action port [ 640.070445] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-4347b86b-bfad-440b-95fc-b43253bc9938 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.072656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4347b86b-bfad-440b-95fc-b43253bc9938" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.072742] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4347b86b-bfad-440b-95fc-b43253bc9938" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.073010] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4347b86b-bfad-440b-95fc-b43253bc9938" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.073096] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4347b86b-bfad-440b-95fc-b43253bc9938',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.145347] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6bcdfd5c-dedd-49c1-92f0-34d66c8857fd [ 640.145660] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.145771] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.145771] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.146424] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.146424] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.146424] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6bcdfd5c-dedd-49c1-92f0-34d66c8857fd already deleted. [ 640.146424] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bcdfd5c-dedd-49c1-92f0-34d66c8857fd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.244420] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.244602] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.244670] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.244892] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.244986] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.245199] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.245485] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.245623] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.245925] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.245925] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.246062] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5333cddc-c089-40b3-9eba-dc3f40477cac already deleted. [ 640.246062] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.358628] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7abade-e912-4196-b558-4a6d4ece9b29 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.358628] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.577415] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4347b86b-bfad-440b-95fc-b43253bc9938 [ 640.577415] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.577415] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.577415] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.577415] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.577415] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.577415] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4347b86b-bfad-440b-95fc-b43253bc9938 already deleted. [ 640.577415] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4347b86b-bfad-440b-95fc-b43253bc9938" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.436481] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: SUCCESS [ 641.438097] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.438097] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.438097] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.438097] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.438097] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.438097] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.438097] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.438097] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.438097] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.438097] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.477014] env[70013]: INFO networking_nsxv3.common.synchronization [req-c97c03ca-1fd6-4eb1-b865-cbf44d1f2ba4 req-e43deec7-cb71-4980-a4f7-7aac2b5bec97 service nova] Enqueued Resource ID: d189cef5-279a-45d3-a52a-a0fb084ee3fa with Priority: HIGHEST for action security_group_rules [ 641.477014] env[70013]: INFO networking_nsxv3.common.synchronization [req-c97c03ca-1fd6-4eb1-b865-cbf44d1f2ba4 req-e43deec7-cb71-4980-a4f7-7aac2b5bec97 service nova] Enqueued Resource ID: d189cef5-279a-45d3-a52a-a0fb084ee3fa with Priority: HIGHEST for action security_group_members [ 641.477014] env[70013]: INFO networking_nsxv3.common.synchronization [req-c97c03ca-1fd6-4eb1-b865-cbf44d1f2ba4 req-e43deec7-cb71-4980-a4f7-7aac2b5bec97 service nova] Enqueued Resource ID: 1e8309fb-0a16-407f-9be0-abcac22185ff with Priority: HIGHEST for action port [ 641.477014] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d189cef5-279a-45d3-a52a-a0fb084ee3fa with Priority: HIGHEST for action security_group_rules [ 641.477014] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d189cef5-279a-45d3-a52a-a0fb084ee3fa with Priority: HIGHEST for action security_group_members [ 641.477014] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e8309fb-0a16-407f-9be0-abcac22185ff with Priority: HIGHEST for action port [ 641.477435] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d189cef5-279a-45d3-a52a-a0fb084ee3fa taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.477558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.477621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.477889] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.477975] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d189cef5-279a-45d3-a52a-a0fb084ee3fa',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.478837] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d189cef5-279a-45d3-a52a-a0fb084ee3fa taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.478952] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.479033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.479219] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.479363] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.479458] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.479522] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.479668] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.479755] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.479843] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d189cef5-279a-45d3-a52a-a0fb084ee3fa',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.481554] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e8309fb-0a16-407f-9be0-abcac22185ff taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.484486] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e8309fb-0a16-407f-9be0-abcac22185ff" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.485516] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e8309fb-0a16-407f-9be0-abcac22185ff" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.485516] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e8309fb-0a16-407f-9be0-abcac22185ff" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.485516] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e8309fb-0a16-407f-9be0-abcac22185ff',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.665804] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-3 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.666187] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.666227] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.666619] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.667016] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.671945] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.671945] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.671945] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.671945] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.671945] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 641.671945] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 641.671945] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 641.671945] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 641.671945] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 641.671945] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 641.671945] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 641.691890] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 641.692126] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 641.692261] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 641.692643] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.694989] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-7cbd6812-9369-466e-a269-def6f4b8ed8f taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.694989] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-7cbd6812-9369-466e-a269-def6f4b8ed8f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.694989] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-7cbd6812-9369-466e-a269-def6f4b8ed8f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.694989] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-7cbd6812-9369-466e-a269-def6f4b8ed8f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.694989] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cbd6812-9369-466e-a269-def6f4b8ed8f',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.941592] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7abade-e912-4196-b558-4a6d4ece9b29 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.941799] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.941865] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.942146] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.942328] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.942429] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.942496] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.942680] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.942788] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.942883] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.943055] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7abade-e912-4196-b558-4a6d4ece9b29 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.943172] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.943217] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.943377] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.943604] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.943993] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.943993] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.943993] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.944367] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.944552] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.944748] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.987898] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e8309fb-0a16-407f-9be0-abcac22185ff with status ACTIVE [ 641.988152] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.988304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.988375] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.988589] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.988678] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.988851] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.988949] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.989022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.989175] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.989261] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.989448] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.989542] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.989604] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.989745] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.989819] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.989903] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e8309fb-0a16-407f-9be0-abcac22185ff is going to be updated. [ 641.991220] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d189cef5-279a-45d3-a52a-a0fb084ee3fa taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.991376] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.991580] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d189cef5-279a-45d3-a52a-a0fb084ee3fa',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.011511] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.011878] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.011997] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.012275] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.012357] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.012560] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e8309fb-0a16-407f-9be0-abcac22185ff" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.200021] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.200021] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.200021] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.200021] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.200021] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.200021] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 7cbd6812-9369-466e-a269-def6f4b8ed8f not found, creating... [ 642.200021] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.200021] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.200021] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.200021] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.200021] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.200957] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.201282] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.201925] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.202051] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.202317] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.202610] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 7cbd6812-9369-466e-a269-def6f4b8ed8f is going to be created. [ 642.232022] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.232022] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.232022] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.232022] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.232022] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.232022] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-7cbd6812-9369-466e-a269-def6f4b8ed8f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.449545] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a7abade-e912-4196-b558-4a6d4ece9b29: rpc.has_security_group_logging(os_id): False [ 642.467040] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.467040] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.467040] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.467040] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.467040] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.467040] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.467040] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.467040] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.467040] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.467040] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.467040] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.467040] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.467040] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.467040] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.467040] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.467708] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.467708] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.467708] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.467708] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.467708] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.467708] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 is going to be updated. [ 642.494218] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d189cef5-279a-45d3-a52a-a0fb084ee3fa',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.524190] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.524190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.524190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.524190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.524190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.533284] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: IN_PROGRESS for 2s [ 642.997843] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.998247] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.998247] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.998331] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.998377] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.998770] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d189cef5-279a-45d3-a52a-a0fb084ee3fa is going to be created. [ 643.023211] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.023363] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.023451] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.023654] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.023817] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.035573] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d189cef5-279a-45d3-a52a-a0fb084ee3fa in Status: UNINITIALIZED for 2s [ 643.236046] env[70013]: INFO networking_nsxv3.common.synchronization [None req-15da7fec-22eb-42b6-a48c-c983be7ed26d None None] Enqueued Resource ID: 996aab0f-749f-46be-8b77-ab563dbae198 with Priority: HIGHEST for action port [ 643.236658] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 996aab0f-749f-46be-8b77-ab563dbae198 with Priority: HIGHEST for action port [ 643.236971] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-996aab0f-749f-46be-8b77-ab563dbae198 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.240797] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-996aab0f-749f-46be-8b77-ab563dbae198" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.240797] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-996aab0f-749f-46be-8b77-ab563dbae198" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.241844] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-996aab0f-749f-46be-8b77-ab563dbae198" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.241923] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('996aab0f-749f-46be-8b77-ab563dbae198',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.325193] env[70013]: INFO networking_nsxv3.common.synchronization [req-93a43920-00ea-49d0-9ee8-939bbe650a83 req-0a38d25e-cad1-489a-a57f-ec9c8e7ca137 tempest-ServerAddressesNegativeTestJSON-1327869760 tempest-ServerAddressesNegativeTestJSON-1327869760-project-member] Enqueued Resource ID: 003a4f7e-1782-4af4-a327-5a4d7c0bee4d with Priority: HIGHEST for action security_group_members [ 643.325844] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 003a4f7e-1782-4af4-a327-5a4d7c0bee4d with Priority: HIGHEST for action security_group_members [ 643.326796] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.327033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.327110] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.327374] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.328088] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.328088] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.328088] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.328088] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.328088] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.328317] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('003a4f7e-1782-4af4-a327-5a4d7c0bee4d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.385290] env[70013]: INFO networking_nsxv3.common.synchronization [req-bb514d95-16d3-46c1-a4f8-34aea5fb138d req-a3f5a0ab-70d1-4958-bdd5-060bab66ab0d tempest-MigrationsAdminTest-81604366 tempest-MigrationsAdminTest-81604366-project-member] Enqueued Resource ID: 572a619a-3a59-46a6-bc09-5d754276356e with Priority: HIGHEST for action security_group_members [ 643.385666] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 572a619a-3a59-46a6-bc09-5d754276356e with Priority: HIGHEST for action security_group_members [ 643.386232] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-572a619a-3a59-46a6-bc09-5d754276356e taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.386232] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.386232] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.386493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.386677] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.386731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.386763] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.386942] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.387058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.387203] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('572a619a-3a59-46a6-bc09-5d754276356e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.750495] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 996aab0f-749f-46be-8b77-ab563dbae198 [ 643.750495] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.750495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.750495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.750495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.750495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.750495] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:996aab0f-749f-46be-8b77-ab563dbae198 already deleted. [ 643.750495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-996aab0f-749f-46be-8b77-ab563dbae198" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.835474] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.835474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.835474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.835474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.835474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.835474] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.835474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.835474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.835474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.835474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.835474] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 003a4f7e-1782-4af4-a327-5a4d7c0bee4d is going to be updated. [ 643.860285] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.860516] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.860516] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.862041] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.862041] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.871349] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 003a4f7e-1782-4af4-a327-5a4d7c0bee4d in Status: IN_PROGRESS for 2s [ 643.891773] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.891941] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.891999] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.892265] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.892365] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.892561] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.893809] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.894028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.894202] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.894202] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.894298] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 572a619a-3a59-46a6-bc09-5d754276356e already deleted. [ 643.894470] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.332975] env[70013]: INFO networking_nsxv3.common.synchronization [None req-1a45a5b1-27ca-4188-b1f0-1004484e2124 None None] Enqueued Resource ID: 9ef1e2d0-301b-4b1f-8bfc-2eecfcb023b3 with Priority: HIGHEST for action port [ 644.333259] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ef1e2d0-301b-4b1f-8bfc-2eecfcb023b3 with Priority: HIGHEST for action port [ 644.333854] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ef1e2d0-301b-4b1f-8bfc-2eecfcb023b3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.333969] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ef1e2d0-301b-4b1f-8bfc-2eecfcb023b3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.334052] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ef1e2d0-301b-4b1f-8bfc-2eecfcb023b3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.334304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ef1e2d0-301b-4b1f-8bfc-2eecfcb023b3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.334380] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ef1e2d0-301b-4b1f-8bfc-2eecfcb023b3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.358172] env[70013]: INFO networking_nsxv3.common.synchronization [req-ca971112-1fdc-43e1-a08f-4a2ce10df748 req-74aa5453-84f3-4e50-a886-c3a9c1ef4a8b service nova] Enqueued Resource ID: 5333cddc-c089-40b3-9eba-dc3f40477cac with Priority: HIGHEST for action security_group_rules [ 644.358172] env[70013]: INFO networking_nsxv3.common.synchronization [req-ca971112-1fdc-43e1-a08f-4a2ce10df748 req-74aa5453-84f3-4e50-a886-c3a9c1ef4a8b service nova] Enqueued Resource ID: 5333cddc-c089-40b3-9eba-dc3f40477cac with Priority: HIGHEST for action security_group_members [ 644.358172] env[70013]: INFO networking_nsxv3.common.synchronization [req-ca971112-1fdc-43e1-a08f-4a2ce10df748 req-74aa5453-84f3-4e50-a886-c3a9c1ef4a8b service nova] Enqueued Resource ID: 7cbd6812-9369-466e-a269-def6f4b8ed8f with Priority: HIGHEST for action port [ 644.358172] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5333cddc-c089-40b3-9eba-dc3f40477cac with Priority: HIGHEST for action security_group_rules [ 644.358172] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5333cddc-c089-40b3-9eba-dc3f40477cac with Priority: HIGHEST for action security_group_members [ 644.358172] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cbd6812-9369-466e-a269-def6f4b8ed8f with Priority: HIGHEST for action port [ 644.358172] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5333cddc-c089-40b3-9eba-dc3f40477cac taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.358172] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.358172] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.358858] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.360155] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5333cddc-c089-40b3-9eba-dc3f40477cac',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.360155] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5333cddc-c089-40b3-9eba-dc3f40477cac taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.360765] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.360905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.361209] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.361406] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.361829] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.361829] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.361990] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.362463] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.362463] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5333cddc-c089-40b3-9eba-dc3f40477cac',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.363777] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cbd6812-9369-466e-a269-def6f4b8ed8f taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.363777] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cbd6812-9369-466e-a269-def6f4b8ed8f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.364144] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cbd6812-9369-466e-a269-def6f4b8ed8f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.364390] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cbd6812-9369-466e-a269-def6f4b8ed8f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.365909] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cbd6812-9369-466e-a269-def6f4b8ed8f',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.544730] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: SUCCESS [ 644.544942] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.796846] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-701 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.797043] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.797164] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.797499] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.797759] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.797859] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.800122] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.800698] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.800954] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.801222] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 644.802027] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 644.802027] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 644.802027] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 644.802027] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 644.802199] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 644.802302] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 644.820513] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 644.820748] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 644.822094] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 644.822094] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.822094] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-b1d9f41a-978e-4fe2-bb42-1a2ab68ce1b2 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.822094] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-b1d9f41a-978e-4fe2-bb42-1a2ab68ce1b2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.822094] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-b1d9f41a-978e-4fe2-bb42-1a2ab68ce1b2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.822094] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-b1d9f41a-978e-4fe2-bb42-1a2ab68ce1b2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.822508] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1d9f41a-978e-4fe2-bb42-1a2ab68ce1b2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.838400] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ef1e2d0-301b-4b1f-8bfc-2eecfcb023b3 [ 644.841252] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.841504] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.841576] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.841806] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.842845] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.842845] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ef1e2d0-301b-4b1f-8bfc-2eecfcb023b3 already deleted. [ 644.842845] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ef1e2d0-301b-4b1f-8bfc-2eecfcb023b3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.866190] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5333cddc-c089-40b3-9eba-dc3f40477cac',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.867736] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5333cddc-c089-40b3-9eba-dc3f40477cac taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.867884] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.869878] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7cbd6812-9369-466e-a269-def6f4b8ed8f with status ACTIVE [ 644.870112] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.870263] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.870917] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.870917] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.871208] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.871208] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.871323] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.871384] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.871550] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.871629] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.872210] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.872210] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.872210] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.872210] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.872210] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.872537] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7cbd6812-9369-466e-a269-def6f4b8ed8f is going to be updated. [ 644.894738] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.894889] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.895656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.895656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.895656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.895656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cbd6812-9369-466e-a269-def6f4b8ed8f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.050627] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d189cef5-279a-45d3-a52a-a0fb084ee3fa in Status: SUCCESS [ 645.050627] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.050627] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.050627] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.050940] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.050940] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.050940] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.051064] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.053467] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.053467] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.053467] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d189cef5-279a-45d3-a52a-a0fb084ee3fa',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.255957] env[70013]: INFO networking_nsxv3.common.synchronization [None req-16018a14-0375-47b2-b20b-8ee716d7852d None None] Enqueued Resource ID: 5b928267-d49b-4bd9-849a-f35d7806d8df with Priority: HIGHEST for action port [ 645.256305] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b928267-d49b-4bd9-849a-f35d7806d8df with Priority: HIGHEST for action port [ 645.256708] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b928267-d49b-4bd9-849a-f35d7806d8df taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.256762] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b928267-d49b-4bd9-849a-f35d7806d8df" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.256811] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b928267-d49b-4bd9-849a-f35d7806d8df" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.262378] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b928267-d49b-4bd9-849a-f35d7806d8df" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.262378] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b928267-d49b-4bd9-849a-f35d7806d8df',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.324538] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.324754] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.325016] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.327528] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.327528] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.327528] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port b1d9f41a-978e-4fe2-bb42-1a2ab68ce1b2 not found, creating... [ 645.327528] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.327528] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.327528] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.327528] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.327528] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.327528] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.327528] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.328145] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.328145] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.328145] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.328145] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: b1d9f41a-978e-4fe2-bb42-1a2ab68ce1b2 is going to be created. [ 645.349369] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.349638] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.349746] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.350939] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.350939] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.350939] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-b1d9f41a-978e-4fe2-bb42-1a2ab68ce1b2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.374998] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5333cddc-c089-40b3-9eba-dc3f40477cac',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.479817] env[70013]: INFO networking_nsxv3.common.synchronization [None req-9ed432a5-68e0-4cb2-b604-4d100c7c5ae8 None None] Enqueued Resource ID: 047312cc-5688-4439-894d-93059b24666c with Priority: HIGHEST for action port [ 645.480729] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 047312cc-5688-4439-894d-93059b24666c with Priority: HIGHEST for action port [ 645.481246] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-047312cc-5688-4439-894d-93059b24666c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.481413] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-047312cc-5688-4439-894d-93059b24666c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.481518] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-047312cc-5688-4439-894d-93059b24666c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.481854] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-047312cc-5688-4439-894d-93059b24666c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.481926] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('047312cc-5688-4439-894d-93059b24666c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.554598] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d189cef5-279a-45d3-a52a-a0fb084ee3fa taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.554740] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.554820] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.555031] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.555885] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.556021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.556136] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.556444] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.556444] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.556444] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.556661] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d189cef5-279a-45d3-a52a-a0fb084ee3fa taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.556744] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.556744] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.557558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.557558] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.557558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.557558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.557558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.557558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.557558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.557558] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d189cef5-279a-45d3-a52a-a0fb084ee3fa',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.612789] env[70013]: INFO networking_nsxv3.common.synchronization [None req-d5f93360-aa5b-48e5-8e86-9f8b35662f5a tempest-ServersTestBootFromVolume-2114082365 tempest-ServersTestBootFromVolume-2114082365-project-member] Enqueued Resource ID: 9327e489-f357-4ab4-ad7d-eea2d96da52c with Priority: HIGHEST for action security_group_rules [ 645.614025] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9327e489-f357-4ab4-ad7d-eea2d96da52c with Priority: HIGHEST for action security_group_rules [ 645.614802] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9327e489-f357-4ab4-ad7d-eea2d96da52c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.615329] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.615329] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.615329] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.615329] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9327e489-f357-4ab4-ad7d-eea2d96da52c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.762066] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b928267-d49b-4bd9-849a-f35d7806d8df [ 645.762066] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.762066] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.762066] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.762066] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.762622] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.762622] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b928267-d49b-4bd9-849a-f35d7806d8df already deleted. [ 645.762622] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b928267-d49b-4bd9-849a-f35d7806d8df" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.877597] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.877936] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.878065] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.878396] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.878494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.878595] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5333cddc-c089-40b3-9eba-dc3f40477cac is going to be created. [ 645.882777] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 003a4f7e-1782-4af4-a327-5a4d7c0bee4d in Status: SUCCESS [ 645.883116] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 003a4f7e-1782-4af4-a327-5a4d7c0bee4d deletion is rescheduled due to dependency. [ 645.883116] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.902784] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.902784] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.902784] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.902784] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.902784] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.910562] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5333cddc-c089-40b3-9eba-dc3f40477cac in Status: UNINITIALIZED for 2s [ 645.987578] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 047312cc-5688-4439-894d-93059b24666c [ 645.987578] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.987578] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.987578] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.987578] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.987578] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.987578] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:047312cc-5688-4439-894d-93059b24666c already deleted. [ 645.987578] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-047312cc-5688-4439-894d-93059b24666c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.061918] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d189cef5-279a-45d3-a52a-a0fb084ee3fa: rpc.has_security_group_logging(os_id): False [ 646.081305] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.081305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.081305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.081305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.081305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.085290] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.087778] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.087778] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.087778] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.087778] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.087778] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.087778] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.087778] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.087778] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.087778] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.089923] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.089923] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.089923] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.089923] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.089923] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.089923] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d189cef5-279a-45d3-a52a-a0fb084ee3fa is going to be created. [ 646.096290] env[70013]: INFO networking_nsxv3.common.synchronization [None req-9dea6a31-bd5a-4d06-a4d8-4ac754f68897 tempest-ServersTestBootFromVolume-2114082365 tempest-ServersTestBootFromVolume-2114082365-project-member] Enqueued Resource ID: 9327e489-f357-4ab4-ad7d-eea2d96da52c with Priority: HIGHEST for action security_group_rules [ 646.096290] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9327e489-f357-4ab4-ad7d-eea2d96da52c with Priority: HIGHEST for action security_group_rules [ 646.096290] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9327e489-f357-4ab4-ad7d-eea2d96da52c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.096290] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.134839] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.135125] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.135202] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.135431] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.135835] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.135835] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9327e489-f357-4ab4-ad7d-eea2d96da52c already deleted. [ 646.135835] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.136060] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.136242] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.136313] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9327e489-f357-4ab4-ad7d-eea2d96da52c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.149199] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.149199] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.149199] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.149199] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.149199] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.152089] env[70013]: INFO networking_nsxv3.common.synchronization [None req-21ea2420-d933-416b-84cf-1eb6d298537d None None] Enqueued Resource ID: 8cd52d19-37be-4cd4-821d-aa267521ad2d with Priority: HIGHEST for action port [ 646.152671] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cd52d19-37be-4cd4-821d-aa267521ad2d with Priority: HIGHEST for action port [ 646.152998] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cd52d19-37be-4cd4-821d-aa267521ad2d taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.153133] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cd52d19-37be-4cd4-821d-aa267521ad2d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.153193] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cd52d19-37be-4cd4-821d-aa267521ad2d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.153490] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cd52d19-37be-4cd4-821d-aa267521ad2d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.153567] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cd52d19-37be-4cd4-821d-aa267521ad2d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.161588] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d189cef5-279a-45d3-a52a-a0fb084ee3fa in Status: IN_PROGRESS for 2s [ 646.265578] env[70013]: INFO networking_nsxv3.common.synchronization [None req-f2212d24-2810-42f1-bad0-021c86b3017a None None] Enqueued Resource ID: 8322bd9e-dc3c-441b-99ee-699ce158303d with Priority: HIGHEST for action port [ 646.266099] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8322bd9e-dc3c-441b-99ee-699ce158303d with Priority: HIGHEST for action port [ 646.266420] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-8322bd9e-dc3c-441b-99ee-699ce158303d taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.266540] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8322bd9e-dc3c-441b-99ee-699ce158303d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.266635] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8322bd9e-dc3c-441b-99ee-699ce158303d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.266905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8322bd9e-dc3c-441b-99ee-699ce158303d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.267607] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8322bd9e-dc3c-441b-99ee-699ce158303d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.655954] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8cd52d19-37be-4cd4-821d-aa267521ad2d [ 646.656185] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.656185] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.657028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.657028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.657028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.657192] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8cd52d19-37be-4cd4-821d-aa267521ad2d already deleted. [ 646.657227] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cd52d19-37be-4cd4-821d-aa267521ad2d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.660354] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.660559] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.660629] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.661579] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.661579] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.661579] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9327e489-f357-4ab4-ad7d-eea2d96da52c already deleted. [ 646.661579] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.774604] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8322bd9e-dc3c-441b-99ee-699ce158303d [ 646.774604] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.774604] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.774604] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.774604] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.776574] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.776574] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8322bd9e-dc3c-441b-99ee-699ce158303d already deleted. [ 646.776574] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8322bd9e-dc3c-441b-99ee-699ce158303d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.793641] env[70013]: INFO networking_nsxv3.common.synchronization [req-bb514d95-16d3-46c1-a4f8-34aea5fb138d req-f481d0f9-354e-4d95-a20e-7bfaf0b4e1f6 service nova] Enqueued Resource ID: 572a619a-3a59-46a6-bc09-5d754276356e with Priority: HIGHEST for action security_group_rules [ 646.793641] env[70013]: INFO networking_nsxv3.common.synchronization [req-bb514d95-16d3-46c1-a4f8-34aea5fb138d req-f481d0f9-354e-4d95-a20e-7bfaf0b4e1f6 service nova] Enqueued Resource ID: 572a619a-3a59-46a6-bc09-5d754276356e with Priority: HIGHEST for action security_group_members [ 646.793641] env[70013]: INFO networking_nsxv3.common.synchronization [req-bb514d95-16d3-46c1-a4f8-34aea5fb138d req-f481d0f9-354e-4d95-a20e-7bfaf0b4e1f6 service nova] Enqueued Resource ID: b1d9f41a-978e-4fe2-bb42-1a2ab68ce1b2 with Priority: HIGHEST for action port [ 646.794836] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 572a619a-3a59-46a6-bc09-5d754276356e with Priority: HIGHEST for action security_group_rules [ 646.794836] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 572a619a-3a59-46a6-bc09-5d754276356e with Priority: HIGHEST for action security_group_members [ 646.794836] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d9f41a-978e-4fe2-bb42-1a2ab68ce1b2 with Priority: HIGHEST for action port [ 646.799081] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-572a619a-3a59-46a6-bc09-5d754276356e taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.799081] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.799081] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.799081] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.799081] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('572a619a-3a59-46a6-bc09-5d754276356e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.799957] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-572a619a-3a59-46a6-bc09-5d754276356e taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.799957] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.800123] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.800231] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.800476] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.801561] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.801561] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.801561] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.801561] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.801561] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('572a619a-3a59-46a6-bc09-5d754276356e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.802195] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1d9f41a-978e-4fe2-bb42-1a2ab68ce1b2 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.802267] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1d9f41a-978e-4fe2-bb42-1a2ab68ce1b2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.802334] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1d9f41a-978e-4fe2-bb42-1a2ab68ce1b2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.802491] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1d9f41a-978e-4fe2-bb42-1a2ab68ce1b2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.802569] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1d9f41a-978e-4fe2-bb42-1a2ab68ce1b2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.910673] env[70013]: INFO networking_nsxv3.common.synchronization [req-29035b6a-6f4f-49d6-94fe-580c50c72742 req-7ce6767f-e207-4275-939f-45f509ee0b97 tempest-DeleteServersTestJSON-1971284771 tempest-DeleteServersTestJSON-1971284771-project-member] Enqueued Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 646.911355] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 646.911658] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.911760] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.911833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.912317] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.912591] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.912729] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.912812] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.913086] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.913193] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.913292] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.306410] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('572a619a-3a59-46a6-bc09-5d754276356e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.307269] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-572a619a-3a59-46a6-bc09-5d754276356e taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.307437] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.307545] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1d9f41a-978e-4fe2-bb42-1a2ab68ce1b2 with status ACTIVE [ 647.307702] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.307843] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.307905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.309966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.309966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.309966] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.309966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.309966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.309966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.309966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.309966] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.309966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.309966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.309966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.309966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.309966] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1d9f41a-978e-4fe2-bb42-1a2ab68ce1b2 is going to be updated. [ 647.332245] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.333314] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.333401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.333689] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.333865] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.334093] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1d9f41a-978e-4fe2-bb42-1a2ab68ce1b2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.415816] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.416000] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.416046] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.416310] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.416382] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.416553] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.416747] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.416747] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.416902] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.416978] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.417135] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b already deleted. [ 647.417203] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.815758] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('572a619a-3a59-46a6-bc09-5d754276356e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.923411] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5333cddc-c089-40b3-9eba-dc3f40477cac in Status: SUCCESS [ 647.923649] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.923826] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.924072] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.924270] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.924420] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.924497] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.924831] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.924831] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.924831] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.925062] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5333cddc-c089-40b3-9eba-dc3f40477cac',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.172574] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d189cef5-279a-45d3-a52a-a0fb084ee3fa in Status: SUCCESS [ 648.172574] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.241396] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-446 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.241583] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-446" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.241704] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-446" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.242053] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-446" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.242313] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.242474] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.242680] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.242801] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.243322] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.243774] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 648.244068] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 648.244243] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 648.244597] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 648.244738] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 648.244900] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 648.245083] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 648.265026] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 648.266204] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 648.266676] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 648.266997] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-446" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.267374] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-75bc1ac5-ec35-4914-abff-0fc9c5eb7bf9 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.267571] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-75bc1ac5-ec35-4914-abff-0fc9c5eb7bf9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.267691] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-75bc1ac5-ec35-4914-abff-0fc9c5eb7bf9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.269038] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-75bc1ac5-ec35-4914-abff-0fc9c5eb7bf9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.269093] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75bc1ac5-ec35-4914-abff-0fc9c5eb7bf9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.319171] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.319473] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.319473] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.319673] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.319960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.319960] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 572a619a-3a59-46a6-bc09-5d754276356e is going to be created. [ 648.342304] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.342304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.342304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.342304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.342528] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.351669] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 572a619a-3a59-46a6-bc09-5d754276356e in Status: UNINITIALIZED for 2s [ 648.428148] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5333cddc-c089-40b3-9eba-dc3f40477cac',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.521069] env[70013]: INFO networking_nsxv3.common.synchronization [None req-24e6fcd7-ecd5-4e7f-945e-6b950dbde475 None None] Enqueued Resource ID: 7f06c404-ead3-4cd6-84e4-c279b21c534f with Priority: HIGHEST for action port [ 648.521315] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f06c404-ead3-4cd6-84e4-c279b21c534f with Priority: HIGHEST for action port [ 648.522414] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f06c404-ead3-4cd6-84e4-c279b21c534f taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.522414] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f06c404-ead3-4cd6-84e4-c279b21c534f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.522519] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f06c404-ead3-4cd6-84e4-c279b21c534f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.522724] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f06c404-ead3-4cd6-84e4-c279b21c534f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.522803] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f06c404-ead3-4cd6-84e4-c279b21c534f',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.741669] env[70013]: INFO networking_nsxv3.common.synchronization [None req-33d9218a-792c-468d-812f-0dc4c4f626ae tempest-ServerActionsTestJSON-1661939768 tempest-ServerActionsTestJSON-1661939768-project-member] Enqueued Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGHEST for action security_group_rules [ 648.742230] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGHEST for action security_group_rules [ 648.742557] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.746119] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.746306] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.746494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.746836] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.776111] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.776111] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.776111] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.776111] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.776111] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.776111] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 75bc1ac5-ec35-4914-abff-0fc9c5eb7bf9 not found, creating... [ 648.776111] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.776111] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.776111] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.776111] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.776684] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.776943] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.779697] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.779697] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.779697] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.779697] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.779697] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 75bc1ac5-ec35-4914-abff-0fc9c5eb7bf9 is going to be created. [ 648.801963] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.801963] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.801963] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.801963] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.801963] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.801963] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-75bc1ac5-ec35-4914-abff-0fc9c5eb7bf9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.930369] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5333cddc-c089-40b3-9eba-dc3f40477cac: rpc.has_security_group_logging(os_id): False [ 648.949668] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.950247] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.950441] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.950797] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.951124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.951544] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.951748] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.951858] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.952085] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.952236] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.952834] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5333cddc-c089-40b3-9eba-dc3f40477cac is going to be created. [ 649.011498] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.011869] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.012029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.012332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.012584] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.023085] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5333cddc-c089-40b3-9eba-dc3f40477cac in Status: IN_PROGRESS for 2s [ 649.024483] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f06c404-ead3-4cd6-84e4-c279b21c534f [ 649.024734] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.024899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.024995] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.025304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.025427] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.025463] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f06c404-ead3-4cd6-84e4-c279b21c534f already deleted. [ 649.025539] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f06c404-ead3-4cd6-84e4-c279b21c534f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.188141] env[70013]: INFO networking_nsxv3.common.synchronization [None req-143b6f25-eead-48ec-8c6b-c28556f74b37 None None] Enqueued Resource ID: 93453fb1-5fba-45d3-bf82-0497ae5a079f with Priority: HIGHEST for action port [ 649.188141] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93453fb1-5fba-45d3-bf82-0497ae5a079f with Priority: HIGHEST for action port [ 649.188141] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-93453fb1-5fba-45d3-bf82-0497ae5a079f taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.188534] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93453fb1-5fba-45d3-bf82-0497ae5a079f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.188702] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93453fb1-5fba-45d3-bf82-0497ae5a079f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.189047] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93453fb1-5fba-45d3-bf82-0497ae5a079f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.189222] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93453fb1-5fba-45d3-bf82-0497ae5a079f',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.212315] env[70013]: INFO networking_nsxv3.common.synchronization [None req-8a9e147d-b158-412c-85ac-b41e27504a3f tempest-ServerActionsTestJSON-1661939768 tempest-ServerActionsTestJSON-1661939768-project-member] Enqueued Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGHEST for action security_group_rules [ 649.213327] env[70013]: INFO networking_nsxv3.common.synchronization [req-8d63ea3e-1954-42ac-b871-be3f6be178cd req-8b36f9db-f35f-44ed-87a8-f3fe64d1f09d tempest-ServersV294TestFqdnHostnames-1836307938 tempest-ServersV294TestFqdnHostnames-1836307938-project-member] Enqueued Resource ID: e4b90d0d-893d-4d8b-9c48-77a47707807a with Priority: HIGHEST for action security_group_members [ 649.215026] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGHEST for action security_group_rules [ 649.215026] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4b90d0d-893d-4d8b-9c48-77a47707807a with Priority: HIGHEST for action security_group_members [ 649.215026] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.215026] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.215026] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4b90d0d-893d-4d8b-9c48-77a47707807a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.215868] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.216078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.216453] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.217038] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.217531] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.218014] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.218362] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.218619] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.218810] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4b90d0d-893d-4d8b-9c48-77a47707807a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.279255] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.279255] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.279255] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.279255] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.279255] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.279255] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 already deleted. [ 649.279602] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.279602] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.279602] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.279727] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.692499] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 93453fb1-5fba-45d3-bf82-0497ae5a079f [ 649.692859] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.692859] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.692859] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.693087] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.693184] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.693358] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:93453fb1-5fba-45d3-bf82-0497ae5a079f already deleted. [ 649.693395] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93453fb1-5fba-45d3-bf82-0497ae5a079f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.726023] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.726023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.726023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.726023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.726023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.726892] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.727107] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.727796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.727796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.727796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.727796] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4b90d0d-893d-4d8b-9c48-77a47707807a already deleted. [ 649.727796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.807025] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.807180] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.807245] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.807463] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.807550] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.807650] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 already deleted. [ 649.807735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.239014] env[70013]: INFO networking_nsxv3.common.synchronization [req-29035b6a-6f4f-49d6-94fe-580c50c72742 req-0927e3a6-ed96-4b43-a40e-ce4af865a3d2 service nova] Enqueued Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_rules [ 650.239288] env[70013]: INFO networking_nsxv3.common.synchronization [req-29035b6a-6f4f-49d6-94fe-580c50c72742 req-0927e3a6-ed96-4b43-a40e-ce4af865a3d2 service nova] Enqueued Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 650.241042] env[70013]: INFO networking_nsxv3.common.synchronization [req-29035b6a-6f4f-49d6-94fe-580c50c72742 req-0927e3a6-ed96-4b43-a40e-ce4af865a3d2 service nova] Enqueued Resource ID: 75bc1ac5-ec35-4914-abff-0fc9c5eb7bf9 with Priority: HIGHEST for action port [ 650.242121] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_rules [ 650.242304] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 650.242459] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75bc1ac5-ec35-4914-abff-0fc9c5eb7bf9 with Priority: HIGHEST for action port [ 650.243084] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.243236] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.243316] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.243629] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.243730] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.245974] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.245974] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.245974] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.246188] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.246251] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.248187] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.248280] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.248594] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.248667] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.248755] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.249576] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-75bc1ac5-ec35-4914-abff-0fc9c5eb7bf9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.249693] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75bc1ac5-ec35-4914-abff-0fc9c5eb7bf9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.249762] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75bc1ac5-ec35-4914-abff-0fc9c5eb7bf9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.249922] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75bc1ac5-ec35-4914-abff-0fc9c5eb7bf9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.250036] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75bc1ac5-ec35-4914-abff-0fc9c5eb7bf9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.362015] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 572a619a-3a59-46a6-bc09-5d754276356e in Status: SUCCESS [ 650.362521] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.362703] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.363020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.363287] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.363405] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.363462] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.363658] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.363750] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.363838] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.363950] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('572a619a-3a59-46a6-bc09-5d754276356e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.551399] env[70013]: INFO networking_nsxv3.common.synchronization [req-121efe45-7a44-4df3-9ad7-2a711718e9b4 req-68484025-ca94-4de9-9957-8a548470ad74 tempest-ImagesTestJSON-851757871 tempest-ImagesTestJSON-851757871-project-member] Enqueued Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 650.551633] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 650.551888] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.552022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.553681] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.553914] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.554107] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.554213] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.554275] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.554447] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.554533] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.554627] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.691800] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-308 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.691991] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-308" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.692200] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-308" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.692480] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-308" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.692762] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.692937] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.693305] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.693549] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.693753] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.694642] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 650.694642] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 650.694642] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 650.694642] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 650.694642] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 650.694642] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 650.694949] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 650.714100] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 650.714355] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 650.714628] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 650.714785] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-308" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.715129] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-c5dfdf74-4ed7-460a-b458-cb45cbc910c2 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.715307] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-c5dfdf74-4ed7-460a-b458-cb45cbc910c2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.715424] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-c5dfdf74-4ed7-460a-b458-cb45cbc910c2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.715766] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-c5dfdf74-4ed7-460a-b458-cb45cbc910c2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.715899] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5dfdf74-4ed7-460a-b458-cb45cbc910c2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.751595] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.752904] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.753053] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.753248] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75bc1ac5-ec35-4914-abff-0fc9c5eb7bf9 with status ACTIVE [ 650.753424] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.753531] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.753595] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.754677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.754677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.754677] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.754677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.754677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.754677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.754677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.754677] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.754677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.755237] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.755237] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.755237] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.755237] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75bc1ac5-ec35-4914-abff-0fc9c5eb7bf9 is going to be updated. [ 650.782025] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.782109] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.782181] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.782397] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.782531] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.782722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75bc1ac5-ec35-4914-abff-0fc9c5eb7bf9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.866592] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-572a619a-3a59-46a6-bc09-5d754276356e taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.866781] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.866837] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.867039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.867413] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.867413] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.867413] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.867554] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.867633] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.867681] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.867819] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-572a619a-3a59-46a6-bc09-5d754276356e taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.867910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.867969] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.868124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.868260] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.868456] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.868456] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.868560] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.868616] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.868698] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.868793] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('572a619a-3a59-46a6-bc09-5d754276356e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.034823] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5333cddc-c089-40b3-9eba-dc3f40477cac in Status: SUCCESS [ 651.035080] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.058813] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.060680] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.060821] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.061396] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.061591] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.061841] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.062584] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.062813] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.063036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.063125] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.063325] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 is going to be updated. [ 651.089703] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.092112] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.092112] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.092112] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.092112] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.100734] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: IN_PROGRESS for 2s [ 651.219233] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.219531] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.219594] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.219869] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.220159] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.221217] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port c5dfdf74-4ed7-460a-b458-cb45cbc910c2 not found, creating... [ 651.221574] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.221922] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.221922] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.222157] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.222304] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.222694] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.222960] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.223082] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.223766] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.223766] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.223766] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: c5dfdf74-4ed7-460a-b458-cb45cbc910c2 is going to be created. [ 651.244653] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.244653] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.245124] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.245124] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.246227] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.246227] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-c5dfdf74-4ed7-460a-b458-cb45cbc910c2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.257589] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.374364] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 572a619a-3a59-46a6-bc09-5d754276356e: rpc.has_security_group_logging(os_id): False [ 651.395066] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.395066] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.395066] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.395066] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.395066] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.395066] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.395066] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.395066] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.395066] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.395066] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.395066] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.395066] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.395066] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.397196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.397196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.397196] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.397196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.397196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.397196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.397196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.397196] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 572a619a-3a59-46a6-bc09-5d754276356e is going to be created. [ 651.495247] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.495247] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.495247] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.495247] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.495247] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.511436] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 572a619a-3a59-46a6-bc09-5d754276356e in Status: IN_PROGRESS for 2s [ 651.764286] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.764438] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.764863] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.764863] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.764863] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.765034] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b is going to be created. [ 651.786604] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.786721] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.786761] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.786971] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.787147] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.796160] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: UNINITIALIZED for 2s [ 652.200233] env[70013]: INFO networking_nsxv3.common.synchronization [None req-a42a0c16-a51e-4111-b52a-522d6ba2c025 None None] Enqueued Resource ID: 40d2d362-fb56-4839-b44b-19d3c0f1da89 with Priority: HIGHEST for action port [ 652.200233] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40d2d362-fb56-4839-b44b-19d3c0f1da89 with Priority: HIGHEST for action port [ 652.201881] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-40d2d362-fb56-4839-b44b-19d3c0f1da89 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.201881] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40d2d362-fb56-4839-b44b-19d3c0f1da89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.201881] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40d2d362-fb56-4839-b44b-19d3c0f1da89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.201881] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40d2d362-fb56-4839-b44b-19d3c0f1da89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.201881] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40d2d362-fb56-4839-b44b-19d3c0f1da89',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.597820] env[70013]: INFO networking_nsxv3.common.synchronization [req-8d63ea3e-1954-42ac-b871-be3f6be178cd req-4b832379-0342-4f72-af89-d0f200eecb75 service nova] Enqueued Resource ID: e4b90d0d-893d-4d8b-9c48-77a47707807a with Priority: HIGHEST for action security_group_rules [ 652.598106] env[70013]: INFO networking_nsxv3.common.synchronization [req-8d63ea3e-1954-42ac-b871-be3f6be178cd req-4b832379-0342-4f72-af89-d0f200eecb75 service nova] Enqueued Resource ID: e4b90d0d-893d-4d8b-9c48-77a47707807a with Priority: HIGHEST for action security_group_members [ 652.598106] env[70013]: INFO networking_nsxv3.common.synchronization [req-8d63ea3e-1954-42ac-b871-be3f6be178cd req-4b832379-0342-4f72-af89-d0f200eecb75 service nova] Enqueued Resource ID: c5dfdf74-4ed7-460a-b458-cb45cbc910c2 with Priority: HIGHEST for action port [ 652.598617] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4b90d0d-893d-4d8b-9c48-77a47707807a with Priority: HIGHEST for action security_group_rules [ 652.598697] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4b90d0d-893d-4d8b-9c48-77a47707807a with Priority: HIGHEST for action security_group_members [ 652.599711] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5dfdf74-4ed7-460a-b458-cb45cbc910c2 with Priority: HIGHEST for action port [ 652.601197] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4b90d0d-893d-4d8b-9c48-77a47707807a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.601480] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.602738] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.602738] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.602738] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4b90d0d-893d-4d8b-9c48-77a47707807a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.603567] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4b90d0d-893d-4d8b-9c48-77a47707807a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.603728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.603850] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.604170] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.604368] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.604548] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.604548] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.605363] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.605363] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.605363] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4b90d0d-893d-4d8b-9c48-77a47707807a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.608037] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5dfdf74-4ed7-460a-b458-cb45cbc910c2 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.608037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5dfdf74-4ed7-460a-b458-cb45cbc910c2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.608037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5dfdf74-4ed7-460a-b458-cb45cbc910c2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.608037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5dfdf74-4ed7-460a-b458-cb45cbc910c2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.608037] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5dfdf74-4ed7-460a-b458-cb45cbc910c2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.703962] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 40d2d362-fb56-4839-b44b-19d3c0f1da89 [ 652.704468] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.704468] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.704634] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.704763] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.705589] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.705589] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:40d2d362-fb56-4839-b44b-19d3c0f1da89 already deleted. [ 652.705589] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40d2d362-fb56-4839-b44b-19d3c0f1da89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.109565] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5dfdf74-4ed7-460a-b458-cb45cbc910c2 with status ACTIVE [ 653.109765] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.109927] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.109997] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.110328] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.110475] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.110699] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.110809] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.110874] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.111060] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.111142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.111352] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.111451] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.111561] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.111746] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.111879] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.111979] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5dfdf74-4ed7-460a-b458-cb45cbc910c2 is going to be updated. [ 653.115801] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4b90d0d-893d-4d8b-9c48-77a47707807a taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.116459] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.116459] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4b90d0d-893d-4d8b-9c48-77a47707807a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.118065] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: IN_PROGRESS for 4s [ 653.148444] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.149915] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.150069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.150307] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.150553] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.150776] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5dfdf74-4ed7-460a-b458-cb45cbc910c2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.526274] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 572a619a-3a59-46a6-bc09-5d754276356e in Status: SUCCESS [ 653.526274] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.620867] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4b90d0d-893d-4d8b-9c48-77a47707807a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.662879] env[70013]: INFO networking_nsxv3.common.synchronization [None req-ef3a2958-4619-405a-b493-01ea0cd95761 None None] Enqueued Resource ID: 815a7e75-83a4-4829-bda7-775d0dd7f37c with Priority: HIGHEST for action port [ 653.663015] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 815a7e75-83a4-4829-bda7-775d0dd7f37c with Priority: HIGHEST for action port [ 653.663300] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-815a7e75-83a4-4829-bda7-775d0dd7f37c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.663429] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-815a7e75-83a4-4829-bda7-775d0dd7f37c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.664046] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-815a7e75-83a4-4829-bda7-775d0dd7f37c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.664512] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-815a7e75-83a4-4829-bda7-775d0dd7f37c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.664674] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('815a7e75-83a4-4829-bda7-775d0dd7f37c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.807112] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: SUCCESS [ 653.808080] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.808080] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.808080] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.808252] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.808408] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.808473] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.808646] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.808723] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.808810] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.808902] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.125210] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.125210] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.125210] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.125210] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.125210] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.125210] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4b90d0d-893d-4d8b-9c48-77a47707807a is going to be created. [ 654.146615] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.146615] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.146615] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.146615] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.146615] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.154280] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4b90d0d-893d-4d8b-9c48-77a47707807a in Status: UNINITIALIZED for 2s [ 654.168815] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 815a7e75-83a4-4829-bda7-775d0dd7f37c [ 654.168815] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.168815] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.168815] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.168815] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.168815] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.168815] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:815a7e75-83a4-4829-bda7-775d0dd7f37c already deleted. [ 654.168815] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-815a7e75-83a4-4829-bda7-775d0dd7f37c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.312218] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.312218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.312218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.312218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.312218] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.312218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.312629] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.312629] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.312629] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.312629] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.312784] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.312832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.312883] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.313869] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.313869] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.313869] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.313869] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.313869] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.313869] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.313869] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.313869] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.816019] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16c877e7-f731-49a5-b994-7d74c36c464b: rpc.has_security_group_logging(os_id): False [ 654.838164] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.838343] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.838409] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.838601] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.838694] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.838914] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.839058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.839122] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.839269] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.839349] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.839531] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.839630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.839740] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.839831] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.839907] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.840118] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.840214] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.840433] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.840433] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.842364] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.842364] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b is going to be created. [ 654.896911] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.896911] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.896911] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.896911] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.896911] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.908568] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: IN_PROGRESS for 2s [ 655.132115] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: SUCCESS [ 655.132115] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 deletion is rescheduled due to dependency. [ 655.132115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.185831] env[70013]: INFO networking_nsxv3.common.synchronization [None req-6f091c1b-6b20-4f33-a495-f1937da63e7b None None] Enqueued Resource ID: 5b37b31a-9cb3-4200-98af-0417410db057 with Priority: HIGHEST for action port [ 655.186472] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b37b31a-9cb3-4200-98af-0417410db057 with Priority: HIGHEST for action port [ 655.187074] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b37b31a-9cb3-4200-98af-0417410db057 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.187074] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b37b31a-9cb3-4200-98af-0417410db057" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.187237] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b37b31a-9cb3-4200-98af-0417410db057" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.187431] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b37b31a-9cb3-4200-98af-0417410db057" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.189668] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b37b31a-9cb3-4200-98af-0417410db057',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.272201] env[70013]: INFO networking_nsxv3.common.synchronization [None req-37b38ef1-60af-46d5-8158-33392518bc04 None None] Enqueued Resource ID: 3e2729b7-9031-4a32-9b36-a25301b7f371 with Priority: HIGHEST for action port [ 655.272455] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e2729b7-9031-4a32-9b36-a25301b7f371 with Priority: HIGHEST for action port [ 655.273036] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e2729b7-9031-4a32-9b36-a25301b7f371 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.273163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e2729b7-9031-4a32-9b36-a25301b7f371" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.273290] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e2729b7-9031-4a32-9b36-a25301b7f371" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.273508] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e2729b7-9031-4a32-9b36-a25301b7f371" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.273600] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e2729b7-9031-4a32-9b36-a25301b7f371',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.286046] env[70013]: INFO networking_nsxv3.common.synchronization [req-e8aa8689-d52b-4690-b2d2-c791159bf215 req-6cfb1b8f-ccde-4d67-b4c9-e848fe215633 tempest-ServersWithSpecificFlavorTestJSON-1827464871 tempest-ServersWithSpecificFlavorTestJSON-1827464871-project-member] Enqueued Resource ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 with Priority: HIGHEST for action security_group_members [ 655.287168] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 with Priority: HIGHEST for action security_group_members [ 655.287168] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.287168] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.292036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.292036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.292036] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.292036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.292036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.292036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.292036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.292036] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.690567] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b37b31a-9cb3-4200-98af-0417410db057 [ 655.691737] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.691737] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.691737] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.691737] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.691737] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.691925] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b37b31a-9cb3-4200-98af-0417410db057 already deleted. [ 655.691925] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b37b31a-9cb3-4200-98af-0417410db057" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.778488] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e2729b7-9031-4a32-9b36-a25301b7f371 [ 655.778719] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.780574] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.780709] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.780912] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.781017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.781126] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e2729b7-9031-4a32-9b36-a25301b7f371 already deleted. [ 655.781212] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e2729b7-9031-4a32-9b36-a25301b7f371" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.793186] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.793267] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.793373] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.793582] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.793664] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.794140] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.794140] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.794140] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.794140] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.794394] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.794394] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 already deleted. [ 655.794394] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.097944] env[70013]: INFO networking_nsxv3.common.synchronization [req-921bd608-79cc-469b-892a-ebc8bdebd1ef req-768ab4e4-6042-49d6-bc8c-fe1f52c1d502 tempest-SecurityGroupRulesNegativeTestJSON-8862349 tempest-SecurityGroupRulesNegativeTestJSON-8862349-project-member] Enqueued Resource ID: 19c3df8d-59d7-4a30-bdae-c6e5eaa618e9 with Priority: HIGHEST for action security_group_rules [ 656.098406] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19c3df8d-59d7-4a30-bdae-c6e5eaa618e9 with Priority: HIGHEST for action security_group_rules [ 656.099601] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19c3df8d-59d7-4a30-bdae-c6e5eaa618e9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.099601] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19c3df8d-59d7-4a30-bdae-c6e5eaa618e9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.099601] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19c3df8d-59d7-4a30-bdae-c6e5eaa618e9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.100410] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19c3df8d-59d7-4a30-bdae-c6e5eaa618e9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.100410] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19c3df8d-59d7-4a30-bdae-c6e5eaa618e9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.165286] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4b90d0d-893d-4d8b-9c48-77a47707807a in Status: SUCCESS [ 656.167022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.167022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.167022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.167022] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.167022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.167022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.167022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.167022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.167022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.167022] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4b90d0d-893d-4d8b-9c48-77a47707807a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.422487] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-2 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.422727] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.422999] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.423315] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.423571] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.423857] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.423857] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.426067] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.426290] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.426478] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 656.426664] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 656.426759] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 656.426915] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 656.426989] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 656.427161] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 656.427340] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 656.451155] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 656.451546] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 656.451832] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 656.452762] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.452762] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-31ef45d2-b59a-4c2c-9fdc-f17ae158e442 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.453647] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-31ef45d2-b59a-4c2c-9fdc-f17ae158e442" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.453954] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-31ef45d2-b59a-4c2c-9fdc-f17ae158e442" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.455415] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-31ef45d2-b59a-4c2c-9fdc-f17ae158e442" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.455415] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31ef45d2-b59a-4c2c-9fdc-f17ae158e442',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.620573] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.621220] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.621434] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.622196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.622408] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.622590] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19c3df8d-59d7-4a30-bdae-c6e5eaa618e9 already deleted. [ 656.623610] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19c3df8d-59d7-4a30-bdae-c6e5eaa618e9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.673568] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4b90d0d-893d-4d8b-9c48-77a47707807a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.815914] env[70013]: INFO networking_nsxv3.common.synchronization [None req-158ad054-2059-449f-be12-4cf67e2bfd24 None None] Enqueued Resource ID: 745888e4-baed-4b6b-b499-a529f27a3ed2 with Priority: HIGHEST for action port [ 656.815914] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 745888e4-baed-4b6b-b499-a529f27a3ed2 with Priority: HIGHEST for action port [ 656.815914] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-745888e4-baed-4b6b-b499-a529f27a3ed2 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.815914] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-745888e4-baed-4b6b-b499-a529f27a3ed2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.816507] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-745888e4-baed-4b6b-b499-a529f27a3ed2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.816813] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-745888e4-baed-4b6b-b499-a529f27a3ed2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.817069] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('745888e4-baed-4b6b-b499-a529f27a3ed2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.920959] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: SUCCESS [ 656.921226] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.958147] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.958398] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.958620] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.958825] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.958981] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.959151] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 31ef45d2-b59a-4c2c-9fdc-f17ae158e442 not found, creating... [ 656.959425] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.959585] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.959703] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.960069] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.960069] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.960356] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.960642] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.960793] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.961025] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.961167] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.961311] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 31ef45d2-b59a-4c2c-9fdc-f17ae158e442 is going to be created. [ 656.978703] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.978913] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.979074] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.979347] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.979577] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.979798] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-31ef45d2-b59a-4c2c-9fdc-f17ae158e442" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.165815] env[70013]: INFO networking_nsxv3.common.synchronization [None req-f376e912-d558-47d0-b402-94eaf745c1ef None None] Enqueued Resource ID: 5cc654f9-0510-4101-993a-248de0c7fb89 with Priority: HIGHEST for action port [ 657.166809] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cc654f9-0510-4101-993a-248de0c7fb89 with Priority: HIGHEST for action port [ 657.166923] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cc654f9-0510-4101-993a-248de0c7fb89 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.167096] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cc654f9-0510-4101-993a-248de0c7fb89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.167159] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cc654f9-0510-4101-993a-248de0c7fb89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.167568] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cc654f9-0510-4101-993a-248de0c7fb89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.167568] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cc654f9-0510-4101-993a-248de0c7fb89',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.179574] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4b90d0d-893d-4d8b-9c48-77a47707807a: rpc.has_security_group_logging(os_id): False [ 657.196958] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.197163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.197206] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.197403] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.197487] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.197722] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.197843] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.197877] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.198085] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.198121] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.198184] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4b90d0d-893d-4d8b-9c48-77a47707807a is going to be created. [ 657.265239] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.265239] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.265239] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.265530] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.265668] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.277488] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4b90d0d-893d-4d8b-9c48-77a47707807a in Status: IN_PROGRESS for 2s [ 657.325274] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 745888e4-baed-4b6b-b499-a529f27a3ed2 [ 657.325274] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.325274] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.325274] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.325274] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.325274] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.325274] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:745888e4-baed-4b6b-b499-a529f27a3ed2 already deleted. [ 657.325274] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-745888e4-baed-4b6b-b499-a529f27a3ed2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.412132] env[70013]: INFO networking_nsxv3.common.synchronization [None req-45c32390-197a-4dfb-9f46-b88bc362f42b tempest-ServerActionsV293TestJSON-1916911121 tempest-ServerActionsV293TestJSON-1916911121-project-member] Enqueued Resource ID: 48314c78-ef82-4312-9437-4a43cc3de63d with Priority: HIGHEST for action security_group_rules [ 657.412804] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48314c78-ef82-4312-9437-4a43cc3de63d with Priority: HIGHEST for action security_group_rules [ 657.415756] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48314c78-ef82-4312-9437-4a43cc3de63d taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.416688] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48314c78-ef82-4312-9437-4a43cc3de63d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.416688] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48314c78-ef82-4312-9437-4a43cc3de63d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.416688] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48314c78-ef82-4312-9437-4a43cc3de63d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.416919] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48314c78-ef82-4312-9437-4a43cc3de63d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.669292] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5cc654f9-0510-4101-993a-248de0c7fb89 [ 657.670266] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.670266] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.670266] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.670266] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.670266] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.670266] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5cc654f9-0510-4101-993a-248de0c7fb89 already deleted. [ 657.670266] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cc654f9-0510-4101-993a-248de0c7fb89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.751378] env[70013]: INFO networking_nsxv3.common.synchronization [None req-154ba2ef-9f43-44a2-9a9f-f759a24a87de tempest-ServerActionsV293TestJSON-1916911121 tempest-ServerActionsV293TestJSON-1916911121-project-member] Enqueued Resource ID: 48314c78-ef82-4312-9437-4a43cc3de63d with Priority: HIGHEST for action security_group_rules [ 657.751572] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48314c78-ef82-4312-9437-4a43cc3de63d with Priority: HIGHEST for action security_group_rules [ 657.752455] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48314c78-ef82-4312-9437-4a43cc3de63d taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.752455] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48314c78-ef82-4312-9437-4a43cc3de63d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.937507] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.940353] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.940353] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.940353] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.940353] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.940353] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48314c78-ef82-4312-9437-4a43cc3de63d already deleted. [ 657.940353] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48314c78-ef82-4312-9437-4a43cc3de63d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.940353] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48314c78-ef82-4312-9437-4a43cc3de63d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.940353] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48314c78-ef82-4312-9437-4a43cc3de63d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.940353] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48314c78-ef82-4312-9437-4a43cc3de63d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.425288] env[70013]: INFO networking_nsxv3.common.synchronization [None req-a05f7c4d-c5a2-41e7-b70d-aba7b572c58d None None] Enqueued Resource ID: c42f2a24-0d65-46ab-96b7-3238e3bf8b69 with Priority: HIGHEST for action port [ 658.425288] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c42f2a24-0d65-46ab-96b7-3238e3bf8b69 with Priority: HIGHEST for action port [ 658.425288] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-c42f2a24-0d65-46ab-96b7-3238e3bf8b69 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.425288] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c42f2a24-0d65-46ab-96b7-3238e3bf8b69" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.425288] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c42f2a24-0d65-46ab-96b7-3238e3bf8b69" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.425943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c42f2a24-0d65-46ab-96b7-3238e3bf8b69" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.426422] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c42f2a24-0d65-46ab-96b7-3238e3bf8b69',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.463897] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.463996] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.464061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.464259] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.464340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.464435] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48314c78-ef82-4312-9437-4a43cc3de63d already deleted. [ 658.464558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48314c78-ef82-4312-9437-4a43cc3de63d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.486781] env[70013]: INFO networking_nsxv3.common.synchronization [req-528358d0-5ffb-46e3-ad9a-7c49da439f9c req-81e9c6a4-73fe-491c-8b4e-6e2895b2ebe4 tempest-SecurityGroupRulesNegativeTestJSON-8862349 tempest-SecurityGroupRulesNegativeTestJSON-8862349-project-member] Enqueued Resource ID: 19c3df8d-59d7-4a30-bdae-c6e5eaa618e9 with Priority: HIGHEST for action security_group_rules [ 658.487540] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19c3df8d-59d7-4a30-bdae-c6e5eaa618e9 with Priority: HIGHEST for action security_group_rules [ 658.487919] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19c3df8d-59d7-4a30-bdae-c6e5eaa618e9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.488069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19c3df8d-59d7-4a30-bdae-c6e5eaa618e9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.488199] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19c3df8d-59d7-4a30-bdae-c6e5eaa618e9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.488402] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19c3df8d-59d7-4a30-bdae-c6e5eaa618e9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.489163] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19c3df8d-59d7-4a30-bdae-c6e5eaa618e9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.519562] env[70013]: INFO networking_nsxv3.common.synchronization [req-e8aa8689-d52b-4690-b2d2-c791159bf215 req-a85da942-66fa-4044-91e0-7f2ac1e4c21b service nova] Enqueued Resource ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 with Priority: HIGHEST for action security_group_rules [ 658.520144] env[70013]: INFO networking_nsxv3.common.synchronization [req-e8aa8689-d52b-4690-b2d2-c791159bf215 req-a85da942-66fa-4044-91e0-7f2ac1e4c21b service nova] Enqueued Resource ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 with Priority: HIGHEST for action security_group_members [ 658.520299] env[70013]: INFO networking_nsxv3.common.synchronization [req-e8aa8689-d52b-4690-b2d2-c791159bf215 req-a85da942-66fa-4044-91e0-7f2ac1e4c21b service nova] Enqueued Resource ID: 31ef45d2-b59a-4c2c-9fdc-f17ae158e442 with Priority: HIGHEST for action port [ 658.520849] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 with Priority: HIGHEST for action security_group_rules [ 658.520977] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 with Priority: HIGHEST for action security_group_members [ 658.523188] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31ef45d2-b59a-4c2c-9fdc-f17ae158e442 with Priority: HIGHEST for action port [ 658.523188] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.523188] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.523188] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.523188] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.523428] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.524137] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.524261] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.524303] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.524480] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.524619] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.524711] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.524766] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.524940] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.525225] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.525342] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.526801] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-31ef45d2-b59a-4c2c-9fdc-f17ae158e442 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.526801] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31ef45d2-b59a-4c2c-9fdc-f17ae158e442" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.526801] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31ef45d2-b59a-4c2c-9fdc-f17ae158e442" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.526801] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31ef45d2-b59a-4c2c-9fdc-f17ae158e442" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.526801] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31ef45d2-b59a-4c2c-9fdc-f17ae158e442',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.929201] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c42f2a24-0d65-46ab-96b7-3238e3bf8b69 [ 658.929531] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.929602] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.930604] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.930604] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.930604] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.930604] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c42f2a24-0d65-46ab-96b7-3238e3bf8b69 already deleted. [ 658.930604] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c42f2a24-0d65-46ab-96b7-3238e3bf8b69" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.007049] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.007220] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.007292] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.007643] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.007643] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.008312] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19c3df8d-59d7-4a30-bdae-c6e5eaa618e9 already deleted. [ 659.008312] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19c3df8d-59d7-4a30-bdae-c6e5eaa618e9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.029356] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.029356] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.032470] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.033396] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31ef45d2-b59a-4c2c-9fdc-f17ae158e442 with status ACTIVE [ 659.034034] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.034034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.034034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.034034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.034268] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.034367] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.034464] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.034506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.036096] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.036096] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.036096] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.036096] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.036390] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.036894] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.036894] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.036894] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31ef45d2-b59a-4c2c-9fdc-f17ae158e442 is going to be updated. [ 659.056528] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.056684] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.056758] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.056967] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.057117] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.057620] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31ef45d2-b59a-4c2c-9fdc-f17ae158e442" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.295148] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4b90d0d-893d-4d8b-9c48-77a47707807a in Status: SUCCESS [ 659.295148] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.505252] env[70013]: INFO networking_nsxv3.common.synchronization [req-3ef8e448-f2f6-406c-947b-16b7d5780607 req-9f6f5e72-e139-4845-8465-397b0d4ee0a3 tempest-InstanceActionsV221TestJSON-1422150622 tempest-InstanceActionsV221TestJSON-1422150622-project-member] Enqueued Resource ID: 6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 with Priority: HIGHEST for action security_group_members [ 659.505881] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 with Priority: HIGHEST for action security_group_members [ 659.507316] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.507463] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.507531] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.507785] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.507950] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.508129] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.508185] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.508537] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.508630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.508753] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.544727] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.016468] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.018773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.018773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.018773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.018773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.019432] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.019432] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.019432] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.019640] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.019741] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.019884] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 already deleted. [ 660.020047] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.045039] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.045039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.045039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.045292] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.045292] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.045355] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 is going to be created. [ 660.070382] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.070382] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.070382] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.070680] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.070799] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.081831] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 in Status: UNINITIALIZED for 2s [ 660.211867] env[70013]: INFO networking_nsxv3.common.synchronization [None req-6e0dce83-2fde-4a11-897c-09a71556a649 None None] Enqueued Resource ID: b3a3f879-065e-4d45-a99b-13aa8d9c155c with Priority: HIGHEST for action port [ 660.212864] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3a3f879-065e-4d45-a99b-13aa8d9c155c with Priority: HIGHEST for action port [ 660.213239] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3a3f879-065e-4d45-a99b-13aa8d9c155c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.213846] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3a3f879-065e-4d45-a99b-13aa8d9c155c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.213846] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3a3f879-065e-4d45-a99b-13aa8d9c155c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.213846] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3a3f879-065e-4d45-a99b-13aa8d9c155c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.213846] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3a3f879-065e-4d45-a99b-13aa8d9c155c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.613235] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-705 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.613637] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-705" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.613709] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-705" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.614906] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-705" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.614906] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.614906] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.615320] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.618403] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.618731] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.619093] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 660.619609] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 660.619609] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 660.619609] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 660.619609] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 660.619815] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 660.619857] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 660.639587] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 660.639587] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 660.639587] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 660.639587] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-705" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.640130] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-09f3d7f9-1529-498f-b393-01af888741b2 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.640222] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-09f3d7f9-1529-498f-b393-01af888741b2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.640345] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-09f3d7f9-1529-498f-b393-01af888741b2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.640813] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-09f3d7f9-1529-498f-b393-01af888741b2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.640893] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09f3d7f9-1529-498f-b393-01af888741b2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.715956] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3a3f879-065e-4d45-a99b-13aa8d9c155c [ 660.718120] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.718120] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.718120] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.718120] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.718120] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.718120] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3a3f879-065e-4d45-a99b-13aa8d9c155c already deleted. [ 660.718120] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3a3f879-065e-4d45-a99b-13aa8d9c155c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.145990] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.146246] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.146370] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.146661] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.146824] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.146979] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 09f3d7f9-1529-498f-b393-01af888741b2 not found, creating... [ 661.147265] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.147536] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.147687] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.147919] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.149475] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.149475] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.149475] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.149475] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.149475] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.149475] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.149475] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 09f3d7f9-1529-498f-b393-01af888741b2 is going to be created. [ 661.177986] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.178520] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.178520] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.178673] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.178942] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.179245] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-09f3d7f9-1529-498f-b393-01af888741b2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.602266] env[70013]: INFO networking_nsxv3.common.synchronization [None req-f6398e28-5003-429f-90b1-0ac3ff3b7b92 None None] Enqueued Resource ID: 7cb6f6ba-3594-47f8-83f8-bc4757d022a2 with Priority: HIGHEST for action port [ 661.602266] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cb6f6ba-3594-47f8-83f8-bc4757d022a2 with Priority: HIGHEST for action port [ 661.602266] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cb6f6ba-3594-47f8-83f8-bc4757d022a2 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.602266] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cb6f6ba-3594-47f8-83f8-bc4757d022a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.602266] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cb6f6ba-3594-47f8-83f8-bc4757d022a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.602266] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cb6f6ba-3594-47f8-83f8-bc4757d022a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.602266] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cb6f6ba-3594-47f8-83f8-bc4757d022a2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.094594] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 in Status: SUCCESS [ 662.095657] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.096200] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.098019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.098019] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.098019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.098019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.098019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.098019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.098019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.098019] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.107371] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7cb6f6ba-3594-47f8-83f8-bc4757d022a2 [ 662.107371] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.107371] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.107371] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.107371] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.107371] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.107371] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7cb6f6ba-3594-47f8-83f8-bc4757d022a2 already deleted. [ 662.107850] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cb6f6ba-3594-47f8-83f8-bc4757d022a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.388067] env[70013]: INFO networking_nsxv3.common.synchronization [req-3ef8e448-f2f6-406c-947b-16b7d5780607 req-eac8cada-700c-4277-a80b-c3120b5c05c7 service nova] Enqueued Resource ID: 6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 with Priority: HIGHEST for action security_group_rules [ 662.388255] env[70013]: INFO networking_nsxv3.common.synchronization [req-3ef8e448-f2f6-406c-947b-16b7d5780607 req-eac8cada-700c-4277-a80b-c3120b5c05c7 service nova] Enqueued Resource ID: 6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 with Priority: HIGHEST for action security_group_members [ 662.388402] env[70013]: INFO networking_nsxv3.common.synchronization [req-3ef8e448-f2f6-406c-947b-16b7d5780607 req-eac8cada-700c-4277-a80b-c3120b5c05c7 service nova] Enqueued Resource ID: 09f3d7f9-1529-498f-b393-01af888741b2 with Priority: HIGHEST for action port [ 662.388962] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 with Priority: HIGHEST for action security_group_rules [ 662.389858] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 with Priority: HIGHEST for action security_group_members [ 662.390751] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09f3d7f9-1529-498f-b393-01af888741b2 with Priority: HIGHEST for action port [ 662.391105] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.391233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.391300] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.391608] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.391690] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.392965] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.393129] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.393179] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.393360] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.393507] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.393641] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.394833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.394833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.394833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.394833] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.395077] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-09f3d7f9-1529-498f-b393-01af888741b2 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.395239] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09f3d7f9-1529-498f-b393-01af888741b2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.395292] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09f3d7f9-1529-498f-b393-01af888741b2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.395507] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09f3d7f9-1529-498f-b393-01af888741b2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.395507] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09f3d7f9-1529-498f-b393-01af888741b2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.604727] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.835033] env[70013]: INFO networking_nsxv3.common.synchronization [None req-fc86e923-7d72-4092-bb99-a9cb80ee9daf None None] Enqueued Resource ID: d3a2fb6a-1b8e-4956-a5d6-b3c319cacee8 with Priority: HIGHEST for action port [ 662.835033] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3a2fb6a-1b8e-4956-a5d6-b3c319cacee8 with Priority: HIGHEST for action port [ 662.835033] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3a2fb6a-1b8e-4956-a5d6-b3c319cacee8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.835033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3a2fb6a-1b8e-4956-a5d6-b3c319cacee8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.835033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3a2fb6a-1b8e-4956-a5d6-b3c319cacee8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.835033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3a2fb6a-1b8e-4956-a5d6-b3c319cacee8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.837761] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3a2fb6a-1b8e-4956-a5d6-b3c319cacee8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.898545] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.899300] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.900633] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.902732] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 09f3d7f9-1529-498f-b393-01af888741b2 with status ACTIVE [ 662.902732] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.902732] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.904158] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.904158] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.904158] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.904158] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.904158] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.904158] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.904491] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.904491] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.905447] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.905447] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.905447] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.905447] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.905447] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.905447] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 09f3d7f9-1529-498f-b393-01af888741b2 is going to be updated. [ 662.941234] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.943050] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.943050] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.943050] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.943050] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.943050] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09f3d7f9-1529-498f-b393-01af888741b2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.110400] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2: rpc.has_security_group_logging(os_id): False [ 663.134702] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.134702] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.134702] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.134702] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.134702] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.134702] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.134702] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.134702] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.134702] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.135063] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.135063] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 is going to be created. [ 663.210624] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.210913] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.210913] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.211114] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.211340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.222621] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 in Status: IN_PROGRESS for 2s [ 663.344060] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d3a2fb6a-1b8e-4956-a5d6-b3c319cacee8 [ 663.344060] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.344060] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.344060] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.344401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.344401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.344401] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d3a2fb6a-1b8e-4956-a5d6-b3c319cacee8 already deleted. [ 663.344551] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3a2fb6a-1b8e-4956-a5d6-b3c319cacee8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.407473] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.910305] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.910305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.910305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.910649] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.910649] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.910902] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 is going to be created. [ 663.936107] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.936657] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.936761] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.936959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.937440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.949918] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 in Status: UNINITIALIZED for 2s [ 663.968932] env[70013]: INFO networking_nsxv3.common.synchronization [None req-013e0e41-e568-4e35-83d1-c5073e6d8b45 None None] Enqueued Resource ID: c3c4fa3e-88d0-4fb7-a0f7-9c65cf14f7b8 with Priority: HIGHEST for action port [ 663.970708] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3c4fa3e-88d0-4fb7-a0f7-9c65cf14f7b8 with Priority: HIGHEST for action port [ 663.971319] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3c4fa3e-88d0-4fb7-a0f7-9c65cf14f7b8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.971574] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3c4fa3e-88d0-4fb7-a0f7-9c65cf14f7b8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.971693] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3c4fa3e-88d0-4fb7-a0f7-9c65cf14f7b8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.972109] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3c4fa3e-88d0-4fb7-a0f7-9c65cf14f7b8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.972240] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3c4fa3e-88d0-4fb7-a0f7-9c65cf14f7b8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.475326] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c3c4fa3e-88d0-4fb7-a0f7-9c65cf14f7b8 [ 664.475612] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.475759] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.475901] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.476078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.476171] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.476262] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c3c4fa3e-88d0-4fb7-a0f7-9c65cf14f7b8 already deleted. [ 664.476422] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3c4fa3e-88d0-4fb7-a0f7-9c65cf14f7b8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.104144] env[70013]: INFO networking_nsxv3.common.synchronization [req-afeae229-8db9-441b-8b9c-adb38b7711c2 req-e015f9d0-d27d-49a7-824d-4c6a704b0877 tempest-ImagesOneServerNegativeTestJSON-165560685 tempest-ImagesOneServerNegativeTestJSON-165560685-project-member] Enqueued Resource ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 with Priority: HIGHEST for action security_group_members [ 665.104694] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 with Priority: HIGHEST for action security_group_members [ 665.105016] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d98818b-c2c5-4242-8897-fe65d03027a5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.105219] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.105219] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.105565] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.105643] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.105739] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.105801] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.105913] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.105997] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.106910] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d98818b-c2c5-4242-8897-fe65d03027a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.234371] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 in Status: SUCCESS [ 665.235214] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.461899] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-796 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.462111] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-796" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.462244] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-796" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.462587] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-796" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.462875] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.464302] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.464481] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.464725] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.464876] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.465188] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 665.465329] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 665.465453] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 665.465549] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 665.465664] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 665.465766] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 665.465898] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 665.486184] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 665.486843] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 665.486843] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 665.486843] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-796" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.487064] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-bfb6aa7f-bef1-4a61-8430-16719d55f556 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.487180] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-bfb6aa7f-bef1-4a61-8430-16719d55f556" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.487260] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-bfb6aa7f-bef1-4a61-8430-16719d55f556" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.487679] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-bfb6aa7f-bef1-4a61-8430-16719d55f556" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.487797] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfb6aa7f-bef1-4a61-8430-16719d55f556',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.612262] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.612575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.612575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.612799] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.612855] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.613043] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.613168] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.613241] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.613393] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.613483] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.613562] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 already deleted. [ 665.613648] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.832048] env[70013]: INFO networking_nsxv3.common.synchronization [None req-faa837e8-7b45-4050-93a6-774ede6ae4a9 None None] Enqueued Resource ID: b1a87030-01d3-44e7-abbd-01c25cf18755 with Priority: HIGHEST for action port [ 665.832395] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a87030-01d3-44e7-abbd-01c25cf18755 with Priority: HIGHEST for action port [ 665.832749] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1a87030-01d3-44e7-abbd-01c25cf18755 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.832973] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1a87030-01d3-44e7-abbd-01c25cf18755" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.832973] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1a87030-01d3-44e7-abbd-01c25cf18755" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.833702] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1a87030-01d3-44e7-abbd-01c25cf18755" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.833702] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1a87030-01d3-44e7-abbd-01c25cf18755',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.959932] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 in Status: SUCCESS [ 665.960190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.960416] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.961017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.961291] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.961515] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.961592] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.961764] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.961817] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.961910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.961998] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.991135] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.991438] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.991514] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.991844] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.992068] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.992196] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port bfb6aa7f-bef1-4a61-8430-16719d55f556 not found, creating... [ 665.992522] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.992624] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.992765] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.993022] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.993171] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.995030] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.995255] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.995393] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.995677] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.995911] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.996058] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: bfb6aa7f-bef1-4a61-8430-16719d55f556 is going to be created. [ 666.017828] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.017926] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.018067] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.018325] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.018568] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.018816] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-bfb6aa7f-bef1-4a61-8430-16719d55f556" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.023097] env[70013]: INFO networking_nsxv3.common.synchronization [req-acc22b6f-6bb0-4687-81f2-2b3f3e1fecf5 req-6db10ba1-ecc5-42cb-8c50-90ddfd89b0a9 tempest-DeleteServersTestJSON-1971284771 tempest-DeleteServersTestJSON-1971284771-project-member] Enqueued Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 666.023809] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 666.024246] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.024756] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.024756] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.024756] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.025261] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.025406] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.025496] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.025682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.025771] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.027049] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.338733] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b1a87030-01d3-44e7-abbd-01c25cf18755 [ 666.339240] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.339240] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.339240] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.339456] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.339544] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.339709] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b1a87030-01d3-44e7-abbd-01c25cf18755 already deleted. [ 666.339709] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1a87030-01d3-44e7-abbd-01c25cf18755" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.464614] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.464754] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.465494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.465494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.465494] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.465494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.465494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.465494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.465973] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.465973] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.465973] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.465973] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.465973] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.466243] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.466243] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.466361] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.466410] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.466522] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.466600] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.466679] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.466767] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.529373] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.529373] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.529373] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.529373] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.529373] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.529373] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.529373] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.529927] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.529927] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.529927] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.529927] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b is going to be updated. [ 666.564037] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.564037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.564037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.564037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.564037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.574131] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: IN_PROGRESS for 2s [ 666.970447] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5: rpc.has_security_group_logging(os_id): False [ 666.989266] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.989266] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.989266] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.989266] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.989266] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.989266] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.990674] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.990674] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.990674] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.990674] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.990674] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.990674] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.990674] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.991092] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.991300] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.991634] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.991929] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.992125] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.993887] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.993887] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.993887] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 is going to be created. [ 667.051282] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.051282] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.051282] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.051282] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.051282] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.068141] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 in Status: IN_PROGRESS for 2s [ 667.252870] env[70013]: INFO networking_nsxv3.common.synchronization [req-afeae229-8db9-441b-8b9c-adb38b7711c2 req-0880b209-4382-44c5-a010-3712eddd2f65 service nova] Enqueued Resource ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 with Priority: HIGHEST for action security_group_rules [ 667.253564] env[70013]: INFO networking_nsxv3.common.synchronization [req-afeae229-8db9-441b-8b9c-adb38b7711c2 req-0880b209-4382-44c5-a010-3712eddd2f65 service nova] Enqueued Resource ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 with Priority: HIGHEST for action security_group_members [ 667.254447] env[70013]: INFO networking_nsxv3.common.synchronization [req-afeae229-8db9-441b-8b9c-adb38b7711c2 req-0880b209-4382-44c5-a010-3712eddd2f65 service nova] Enqueued Resource ID: bfb6aa7f-bef1-4a61-8430-16719d55f556 with Priority: HIGHEST for action port [ 667.255531] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 with Priority: HIGHEST for action security_group_rules [ 667.255710] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 with Priority: HIGHEST for action security_group_members [ 667.255820] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfb6aa7f-bef1-4a61-8430-16719d55f556 with Priority: HIGHEST for action port [ 667.256237] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d98818b-c2c5-4242-8897-fe65d03027a5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.256585] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.256585] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.256585] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.256679] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d98818b-c2c5-4242-8897-fe65d03027a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.258953] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d98818b-c2c5-4242-8897-fe65d03027a5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.258953] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.258953] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.258953] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.258953] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.258953] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.258953] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.259373] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.259373] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.259373] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d98818b-c2c5-4242-8897-fe65d03027a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.260360] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfb6aa7f-bef1-4a61-8430-16719d55f556 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.260516] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfb6aa7f-bef1-4a61-8430-16719d55f556" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.261018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfb6aa7f-bef1-4a61-8430-16719d55f556" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.265096] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfb6aa7f-bef1-4a61-8430-16719d55f556" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.265366] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfb6aa7f-bef1-4a61-8430-16719d55f556',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.610804] env[70013]: INFO networking_nsxv3.common.synchronization [None req-cc8093ac-cebb-4d9b-b43e-b4fc04122019 None None] Enqueued Resource ID: cfe265e4-83e2-4333-a7bc-399e21ce3277 with Priority: HIGHEST for action port [ 667.611361] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfe265e4-83e2-4333-a7bc-399e21ce3277 with Priority: HIGHEST for action port [ 667.612015] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfe265e4-83e2-4333-a7bc-399e21ce3277 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.612015] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfe265e4-83e2-4333-a7bc-399e21ce3277" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.612015] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfe265e4-83e2-4333-a7bc-399e21ce3277" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.612516] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfe265e4-83e2-4333-a7bc-399e21ce3277" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.612516] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfe265e4-83e2-4333-a7bc-399e21ce3277',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.767934] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d98818b-c2c5-4242-8897-fe65d03027a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.771019] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d98818b-c2c5-4242-8897-fe65d03027a5 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.771019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.771019] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bfb6aa7f-bef1-4a61-8430-16719d55f556 with status ACTIVE [ 667.771019] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.771019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.771019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.771019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.771019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.771019] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.771019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.771019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.771019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.771019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.771019] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.771691] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.771691] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.771691] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.771691] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.771691] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bfb6aa7f-bef1-4a61-8430-16719d55f556 is going to be updated. [ 667.792022] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.792177] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.792238] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.792460] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.792592] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.792749] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfb6aa7f-bef1-4a61-8430-16719d55f556" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.115957] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cfe265e4-83e2-4333-a7bc-399e21ce3277 [ 668.115957] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.115957] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.115957] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.115957] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.115957] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.115957] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cfe265e4-83e2-4333-a7bc-399e21ce3277 already deleted. [ 668.115957] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfe265e4-83e2-4333-a7bc-399e21ce3277" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.275550] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d98818b-c2c5-4242-8897-fe65d03027a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.584392] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: SUCCESS [ 668.584960] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b deletion is rescheduled due to dependency. [ 668.585381] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.779598] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.779876] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.779876] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.780093] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.780192] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.780290] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 is going to be created. [ 668.804566] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.804747] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.804831] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.805112] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.805295] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.819482] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 in Status: UNINITIALIZED for 2s [ 669.084576] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 in Status: SUCCESS [ 669.084814] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.653730] env[70013]: INFO networking_nsxv3.common.synchronization [req-31006f5b-23ce-45a2-8bd2-c1f83f75c4db req-ed8bd750-9d11-42c8-8a3c-00256968cb74 tempest-ServersTestManualDisk-1313496142 tempest-ServersTestManualDisk-1313496142-project-member] Enqueued Resource ID: 73383895-5111-42cc-a071-b2512b2f23af with Priority: HIGHEST for action security_group_members [ 669.654284] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73383895-5111-42cc-a071-b2512b2f23af with Priority: HIGHEST for action security_group_members [ 669.654613] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-73383895-5111-42cc-a071-b2512b2f23af taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.654740] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.654803] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.655009] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.656129] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.656249] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.656308] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.656498] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.656581] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.656673] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('73383895-5111-42cc-a071-b2512b2f23af',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.160965] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.161325] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.161407] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.161690] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.161821] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.162066] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.162216] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.162396] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.162488] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.162570] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.162665] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73383895-5111-42cc-a071-b2512b2f23af is going to be updated. [ 670.197505] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.197762] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.198982] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.198982] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.198982] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.210234] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73383895-5111-42cc-a071-b2512b2f23af in Status: IN_PROGRESS for 2s [ 670.226824] env[70013]: INFO networking_nsxv3.common.synchronization [req-39e3d598-6e58-4eb3-adc6-2748402a8d15 req-c45b0fe7-cc57-4364-a597-1a53f857ec08 tempest-FloatingIPsAssociationTestJSON-1070439366 tempest-FloatingIPsAssociationTestJSON-1070439366-project-member] Enqueued Resource ID: ff280f19-627b-45ca-afac-7d9154581e89 with Priority: HIGHEST for action security_group_members [ 670.227439] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff280f19-627b-45ca-afac-7d9154581e89 with Priority: HIGHEST for action security_group_members [ 670.227774] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff280f19-627b-45ca-afac-7d9154581e89 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.227905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.228286] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.229132] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.229132] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.229132] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.229132] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.229132] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.229132] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.229132] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff280f19-627b-45ca-afac-7d9154581e89',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.689796] env[70013]: INFO networking_nsxv3.common.synchronization [None req-3c1126fa-f3a7-4423-a487-69ea59bfc766 None None] Enqueued Resource ID: 73e4879b-0996-425c-b469-263379b922c2 with Priority: HIGHEST for action port [ 670.692023] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73e4879b-0996-425c-b469-263379b922c2 with Priority: HIGHEST for action port [ 670.692023] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-73e4879b-0996-425c-b469-263379b922c2 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.692023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73e4879b-0996-425c-b469-263379b922c2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.692023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73e4879b-0996-425c-b469-263379b922c2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.692023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73e4879b-0996-425c-b469-263379b922c2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.692023] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73e4879b-0996-425c-b469-263379b922c2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.736138] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff280f19-627b-45ca-afac-7d9154581e89',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.831098] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 in Status: SUCCESS [ 670.832039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.832039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.832039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.832039] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.832039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.832311] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.832311] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.832311] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.832377] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.834125] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d98818b-c2c5-4242-8897-fe65d03027a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.150022] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-177 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.150234] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-177" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.150362] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-177" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.150729] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-177" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.151029] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.151213] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.151336] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.151581] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.151739] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.152026] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 671.152177] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 671.152725] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 671.152878] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 671.153023] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 671.153138] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 671.153273] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 671.171272] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 671.171645] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 671.171645] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 671.171698] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-177" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.172010] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-b2ae7c4e-fcb4-4d62-9ff1-82de773af513 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.172305] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-b2ae7c4e-fcb4-4d62-9ff1-82de773af513" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.172334] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-b2ae7c4e-fcb4-4d62-9ff1-82de773af513" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.172681] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-b2ae7c4e-fcb4-4d62-9ff1-82de773af513" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.172799] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2ae7c4e-fcb4-4d62-9ff1-82de773af513',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.195918] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73e4879b-0996-425c-b469-263379b922c2 [ 671.196392] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.196544] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.196647] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.196829] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.196921] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.197032] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73e4879b-0996-425c-b469-263379b922c2 already deleted. [ 671.197140] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73e4879b-0996-425c-b469-263379b922c2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.237853] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff280f19-627b-45ca-afac-7d9154581e89',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.335441] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d98818b-c2c5-4242-8897-fe65d03027a5 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.335616] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.335690] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.336022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.337046] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.337046] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.337046] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.337046] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.337217] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.337217] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.337347] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d98818b-c2c5-4242-8897-fe65d03027a5 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.337578] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.337578] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.337656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.337774] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.337880] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.338064] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.338064] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.338233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.338233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.338313] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d98818b-c2c5-4242-8897-fe65d03027a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.619310] env[70013]: INFO networking_nsxv3.common.synchronization [req-9eb3a214-7a4b-4fda-831a-d21a46069753 req-a63f376c-28a9-40f1-84e9-ccfa5f2a93cc tempest-ServersTestFqdnHostnames-357486929 tempest-ServersTestFqdnHostnames-357486929-project-member] Enqueued Resource ID: 7a9726c0-7c30-4b11-81a1-9a9fcc702273 with Priority: HIGHEST for action security_group_members [ 671.620322] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a9726c0-7c30-4b11-81a1-9a9fcc702273 with Priority: HIGHEST for action security_group_members [ 671.620895] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a9726c0-7c30-4b11-81a1-9a9fcc702273 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.621240] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.621691] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.621691] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.621854] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.622046] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.622538] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.622700] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.622778] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.623233] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a9726c0-7c30-4b11-81a1-9a9fcc702273',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.676601] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.677121] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.677692] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.678109] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.678358] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.678597] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port b2ae7c4e-fcb4-4d62-9ff1-82de773af513 not found, creating... [ 671.679108] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.679900] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.680155] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.680617] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.680919] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.681392] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.681822] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.682033] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.682340] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.682587] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.683305] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: b2ae7c4e-fcb4-4d62-9ff1-82de773af513 is going to be created. [ 671.705811] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.706177] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.706177] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.706956] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.706956] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.706956] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-b2ae7c4e-fcb4-4d62-9ff1-82de773af513" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.741590] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.741851] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.741851] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.742096] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.742185] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.742318] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff280f19-627b-45ca-afac-7d9154581e89 is going to be updated. [ 671.797725] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.797882] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.797979] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.798347] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.798386] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.811201] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff280f19-627b-45ca-afac-7d9154581e89 in Status: IN_PROGRESS for 2s [ 671.844399] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d98818b-c2c5-4242-8897-fe65d03027a5: rpc.has_security_group_logging(os_id): False [ 671.867968] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.868131] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.868219] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.869016] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.869016] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.869016] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.869016] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.869016] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.869240] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.870071] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.870071] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.870071] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.870071] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.870071] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.870071] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.870388] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.870388] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.870388] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.870707] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.870707] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.871232] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 is going to be created. [ 671.937026] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.937026] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.937026] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.937366] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.937508] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.952170] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 in Status: IN_PROGRESS for 2s [ 672.127106] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.127284] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.127368] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.127564] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.127679] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.127889] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.128031] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.128069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.128237] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.128289] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.128375] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a9726c0-7c30-4b11-81a1-9a9fcc702273 is going to be updated. [ 672.160973] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.160973] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.160973] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.160973] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.161138] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.173888] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a9726c0-7c30-4b11-81a1-9a9fcc702273 in Status: IN_PROGRESS for 2s [ 672.228321] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 73383895-5111-42cc-a071-b2512b2f23af in Status: SUCCESS [ 672.228557] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 73383895-5111-42cc-a071-b2512b2f23af deletion is rescheduled due to dependency. [ 672.228617] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.507022] env[70013]: INFO networking_nsxv3.common.synchronization [req-39e3d598-6e58-4eb3-adc6-2748402a8d15 req-ef071fb3-bbce-4100-bb6e-8fc4e1ceca85 service nova] Enqueued Resource ID: ff280f19-627b-45ca-afac-7d9154581e89 with Priority: HIGHEST for action security_group_rules [ 672.507022] env[70013]: INFO networking_nsxv3.common.synchronization [req-39e3d598-6e58-4eb3-adc6-2748402a8d15 req-ef071fb3-bbce-4100-bb6e-8fc4e1ceca85 service nova] Enqueued Resource ID: ff280f19-627b-45ca-afac-7d9154581e89 with Priority: HIGHEST for action security_group_members [ 672.507022] env[70013]: INFO networking_nsxv3.common.synchronization [req-39e3d598-6e58-4eb3-adc6-2748402a8d15 req-ef071fb3-bbce-4100-bb6e-8fc4e1ceca85 service nova] Enqueued Resource ID: b2ae7c4e-fcb4-4d62-9ff1-82de773af513 with Priority: HIGHEST for action port [ 672.507167] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff280f19-627b-45ca-afac-7d9154581e89 with Priority: HIGHEST for action security_group_rules [ 672.507297] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff280f19-627b-45ca-afac-7d9154581e89 with Priority: HIGHEST for action security_group_members [ 672.510569] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2ae7c4e-fcb4-4d62-9ff1-82de773af513 with Priority: HIGHEST for action port [ 672.511799] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff280f19-627b-45ca-afac-7d9154581e89 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.511941] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.512014] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.512234] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.512317] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff280f19-627b-45ca-afac-7d9154581e89',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.513176] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff280f19-627b-45ca-afac-7d9154581e89 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.513271] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.513456] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2ae7c4e-fcb4-4d62-9ff1-82de773af513 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.513551] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2ae7c4e-fcb4-4d62-9ff1-82de773af513" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.513613] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2ae7c4e-fcb4-4d62-9ff1-82de773af513" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.513801] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2ae7c4e-fcb4-4d62-9ff1-82de773af513" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.513873] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2ae7c4e-fcb4-4d62-9ff1-82de773af513',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.025049] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff280f19-627b-45ca-afac-7d9154581e89 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.025049] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.025049] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b2ae7c4e-fcb4-4d62-9ff1-82de773af513 with status ACTIVE [ 673.025049] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.025049] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.025049] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.025049] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.025049] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.025404] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.025404] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.025481] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.025586] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.025678] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.025874] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.026408] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.026501] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.026658] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.026737] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.026825] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b2ae7c4e-fcb4-4d62-9ff1-82de773af513 is going to be updated. [ 673.050214] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.050292] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.050519] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.050675] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.050707] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.051028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2ae7c4e-fcb4-4d62-9ff1-82de773af513" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.828143] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff280f19-627b-45ca-afac-7d9154581e89 in Status: SUCCESS [ 673.828143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.828143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.828465] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.828508] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.828782] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.828892] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.829083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.829169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.829265] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff280f19-627b-45ca-afac-7d9154581e89',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.965437] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 in Status: SUCCESS [ 673.969285] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.186425] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a9726c0-7c30-4b11-81a1-9a9fcc702273 in Status: SUCCESS [ 674.186425] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a9726c0-7c30-4b11-81a1-9a9fcc702273 deletion is rescheduled due to dependency. [ 674.186425] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.215180] env[70013]: INFO networking_nsxv3.common.synchronization [None req-4b7c42c8-1cf1-45e1-bd2d-f206362b4e7e None None] Enqueued Resource ID: 5332849d-9a4d-4644-8514-0fea8fb30417 with Priority: HIGHEST for action port [ 674.215419] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5332849d-9a4d-4644-8514-0fea8fb30417 with Priority: HIGHEST for action port [ 674.216082] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-5332849d-9a4d-4644-8514-0fea8fb30417 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.216082] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5332849d-9a4d-4644-8514-0fea8fb30417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.216082] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5332849d-9a4d-4644-8514-0fea8fb30417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.216584] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5332849d-9a4d-4644-8514-0fea8fb30417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.216675] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5332849d-9a4d-4644-8514-0fea8fb30417',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.331942] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff280f19-627b-45ca-afac-7d9154581e89',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.445895] env[70013]: INFO networking_nsxv3.common.synchronization [req-3a0aeb12-7aa0-418d-94e3-66b632cefbcb req-1c6643ed-bdc9-46c9-8466-148a029b3d47 tempest-DeleteServersAdminTestJSON-1322678731 tempest-DeleteServersAdminTestJSON-1322678731-project-member] Enqueued Resource ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 with Priority: HIGHEST for action security_group_members [ 674.447267] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 with Priority: HIGHEST for action security_group_members [ 674.447791] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16fadac6-f5a2-4997-b67b-221b3b4e45a8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.448214] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.448406] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.450663] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.450663] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.450663] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.450663] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.450663] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.450663] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.450663] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16fadac6-f5a2-4997-b67b-221b3b4e45a8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.723018] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5332849d-9a4d-4644-8514-0fea8fb30417 [ 674.723018] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.723018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.723018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.723018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.723018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.723018] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5332849d-9a4d-4644-8514-0fea8fb30417 already deleted. [ 674.723018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5332849d-9a4d-4644-8514-0fea8fb30417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.835321] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff280f19-627b-45ca-afac-7d9154581e89',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.952162] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.952321] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.953051] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.953051] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.953051] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.953051] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.953051] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.953051] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.953291] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.953291] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.953347] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 is going to be updated. [ 674.978814] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.978964] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.979132] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.979283] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.979422] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.989028] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 in Status: IN_PROGRESS for 2s [ 675.338630] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.338825] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.338945] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.339201] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.339311] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.339413] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff280f19-627b-45ca-afac-7d9154581e89 is going to be updated. [ 675.368093] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.368282] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.368367] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.368588] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.368756] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.379537] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff280f19-627b-45ca-afac-7d9154581e89 in Status: IN_PROGRESS for 2s [ 675.397039] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-701 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.397237] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.397306] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.397551] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.398173] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.398173] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.399927] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.399927] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.400053] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.403526] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 675.403776] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 675.403948] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 675.404092] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 675.404219] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 675.404327] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 675.404467] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 675.430275] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 675.430275] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 675.430275] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 675.430275] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.430275] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-5107e297-9610-48b2-bcdf-2ec121611559 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.430275] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-5107e297-9610-48b2-bcdf-2ec121611559" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.430275] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-5107e297-9610-48b2-bcdf-2ec121611559" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.430275] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-5107e297-9610-48b2-bcdf-2ec121611559" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.430275] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5107e297-9610-48b2-bcdf-2ec121611559',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.757108] env[70013]: INFO networking_nsxv3.common.synchronization [None req-d02fc737-65ec-4568-983c-68b077fb3c0a tempest-ServersTestJSON-2095302437 tempest-ServersTestJSON-2095302437-project-member] Enqueued Resource ID: d1b8da2b-4abc-407f-9635-008e18b53627 with Priority: HIGHEST for action security_group_rules [ 675.757817] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1b8da2b-4abc-407f-9635-008e18b53627 with Priority: HIGHEST for action security_group_rules [ 675.758797] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1b8da2b-4abc-407f-9635-008e18b53627 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.758797] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.758797] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.758797] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.761025] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1b8da2b-4abc-407f-9635-008e18b53627',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.852935] env[70013]: INFO networking_nsxv3.common.synchronization [None req-857f186f-b3ff-4992-be15-60b06afa5c78 tempest-ServersTestJSON-2095302437 tempest-ServersTestJSON-2095302437-project-member] Enqueued Resource ID: d1b8da2b-4abc-407f-9635-008e18b53627 with Priority: HIGHEST for action security_group_rules [ 675.853538] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1b8da2b-4abc-407f-9635-008e18b53627 with Priority: HIGHEST for action security_group_rules [ 675.853820] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1b8da2b-4abc-407f-9635-008e18b53627 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.853900] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.933305] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.934587] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.935364] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.937726] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.937726] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.937726] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 5107e297-9610-48b2-bcdf-2ec121611559 not found, creating... [ 675.937862] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.938201] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.938201] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.938398] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.938529] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.945018] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.945018] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.945018] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.945018] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.945018] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.945018] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 5107e297-9610-48b2-bcdf-2ec121611559 is going to be created. [ 675.964198] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.966396] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.966396] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.966396] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.966396] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.966396] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-5107e297-9610-48b2-bcdf-2ec121611559" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.281216] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.281355] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.281423] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.281638] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.281730] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.281822] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1b8da2b-4abc-407f-9635-008e18b53627 already deleted. [ 676.281905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.282062] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.282218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.282295] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1b8da2b-4abc-407f-9635-008e18b53627',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.286159] env[70013]: INFO networking_nsxv3.common.synchronization [None req-a804e414-611a-4455-944e-30e32a79dcb1 None None] Enqueued Resource ID: 71d3e0ff-27a2-4224-8c08-fa1f45d5dbdf with Priority: HIGHEST for action port [ 676.286896] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71d3e0ff-27a2-4224-8c08-fa1f45d5dbdf with Priority: HIGHEST for action port [ 676.287292] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-71d3e0ff-27a2-4224-8c08-fa1f45d5dbdf taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.287418] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71d3e0ff-27a2-4224-8c08-fa1f45d5dbdf" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.287522] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71d3e0ff-27a2-4224-8c08-fa1f45d5dbdf" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.289746] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71d3e0ff-27a2-4224-8c08-fa1f45d5dbdf" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.289841] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71d3e0ff-27a2-4224-8c08-fa1f45d5dbdf',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.792346] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71d3e0ff-27a2-4224-8c08-fa1f45d5dbdf [ 676.792346] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.792346] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.792346] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.792346] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.792346] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.792346] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71d3e0ff-27a2-4224-8c08-fa1f45d5dbdf already deleted. [ 676.792346] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71d3e0ff-27a2-4224-8c08-fa1f45d5dbdf" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.806277] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.806277] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.806277] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.806277] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.806277] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.806277] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1b8da2b-4abc-407f-9635-008e18b53627 already deleted. [ 676.806277] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.972276] env[70013]: INFO networking_nsxv3.common.synchronization [req-3a0aeb12-7aa0-418d-94e3-66b632cefbcb req-f927d2dd-f6a6-4019-a7a9-4b8004e68daa service nova] Enqueued Resource ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 with Priority: HIGHEST for action security_group_rules [ 676.972599] env[70013]: INFO networking_nsxv3.common.synchronization [req-3a0aeb12-7aa0-418d-94e3-66b632cefbcb req-f927d2dd-f6a6-4019-a7a9-4b8004e68daa service nova] Enqueued Resource ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 with Priority: HIGHEST for action security_group_members [ 676.972646] env[70013]: INFO networking_nsxv3.common.synchronization [req-3a0aeb12-7aa0-418d-94e3-66b632cefbcb req-f927d2dd-f6a6-4019-a7a9-4b8004e68daa service nova] Enqueued Resource ID: 5107e297-9610-48b2-bcdf-2ec121611559 with Priority: HIGHEST for action port [ 676.974429] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 with Priority: HIGHEST for action security_group_rules [ 676.974429] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 with Priority: HIGHEST for action security_group_members [ 676.974429] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5107e297-9610-48b2-bcdf-2ec121611559 with Priority: HIGHEST for action port [ 676.974429] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16fadac6-f5a2-4997-b67b-221b3b4e45a8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.974429] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.974429] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.974429] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.975111] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16fadac6-f5a2-4997-b67b-221b3b4e45a8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.979033] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16fadac6-f5a2-4997-b67b-221b3b4e45a8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.979033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.979033] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-5107e297-9610-48b2-bcdf-2ec121611559 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.979033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5107e297-9610-48b2-bcdf-2ec121611559" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.979033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5107e297-9610-48b2-bcdf-2ec121611559" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.979033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5107e297-9610-48b2-bcdf-2ec121611559" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.979033] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5107e297-9610-48b2-bcdf-2ec121611559',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.004889] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 in Status: SUCCESS [ 677.004889] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 deletion is rescheduled due to dependency. [ 677.004889] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.004889] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.004889] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.004889] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.004889] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.004889] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.004889] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.004889] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.004889] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16fadac6-f5a2-4997-b67b-221b3b4e45a8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.390827] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff280f19-627b-45ca-afac-7d9154581e89 in Status: SUCCESS [ 677.391112] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.391985] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.391985] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.392806] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.392806] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.392806] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.392806] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.392806] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.392806] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.392806] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ff280f19-627b-45ca-afac-7d9154581e89',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.481477] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5107e297-9610-48b2-bcdf-2ec121611559 with status ACTIVE [ 677.483920] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.483920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.483920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.483920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.483920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.483920] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.483920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.483920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.483920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.483920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.483920] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.483920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.483920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.483920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.483920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.483920] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5107e297-9610-48b2-bcdf-2ec121611559 is going to be updated. [ 677.485327] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16fadac6-f5a2-4997-b67b-221b3b4e45a8 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.485445] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.504620] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.504620] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.504620] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.504620] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.504921] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.505184] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5107e297-9610-48b2-bcdf-2ec121611559" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.509560] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16fadac6-f5a2-4997-b67b-221b3b4e45a8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.899557] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff280f19-627b-45ca-afac-7d9154581e89 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.899875] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.900062] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.900353] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.900616] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.900781] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.900891] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.902173] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.902341] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.902600] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.902875] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff280f19-627b-45ca-afac-7d9154581e89 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.902875] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.903010] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.903229] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.903580] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.903580] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.903682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.903846] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.903975] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.904123] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.904262] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ff280f19-627b-45ca-afac-7d9154581e89',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.013023] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16fadac6-f5a2-4997-b67b-221b3b4e45a8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.407925] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ff280f19-627b-45ca-afac-7d9154581e89: rpc.has_security_group_logging(os_id): False [ 678.426954] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.427141] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.427216] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.427470] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.427583] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.427833] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.427943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.428040] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.429378] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.429378] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.429378] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.429378] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.429378] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.429378] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.429378] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.429378] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.430891] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.430891] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.431136] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.431295] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.431432] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff280f19-627b-45ca-afac-7d9154581e89 is going to be updated. [ 678.488554] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.490421] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.490697] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.491193] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.492216] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.503589] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff280f19-627b-45ca-afac-7d9154581e89 in Status: IN_PROGRESS for 2s [ 678.516454] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.516557] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.516637] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.516860] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.516950] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.517059] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 is going to be updated. [ 678.544736] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.544846] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.544929] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.545192] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.545345] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.552924] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 in Status: IN_PROGRESS for 2s [ 679.195352] env[70013]: INFO networking_nsxv3.common.synchronization [req-2efc0ca8-1101-4645-8662-ea4fe4b05789 req-1de99a41-e514-4331-8a0f-7ed337118da2 tempest-InstanceActionsV221TestJSON-1422150622 tempest-InstanceActionsV221TestJSON-1422150622-project-member] Enqueued Resource ID: 6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 with Priority: HIGHEST for action security_group_members [ 679.195699] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 with Priority: HIGHEST for action security_group_members [ 679.197432] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.198720] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.198720] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.199025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.199157] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.199275] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.199360] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.199586] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.199938] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.199938] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.626940] env[70013]: INFO networking_nsxv3.common.synchronization [req-2282cce1-55ac-4c4f-9b3e-4d6732717da4 req-8fc477e7-8df2-46ae-8d32-fab4ed4c0aa8 tempest-ServerPasswordTestJSON-928370253 tempest-ServerPasswordTestJSON-928370253-project-member] Enqueued Resource ID: 667765ac-1a17-4f77-a3e3-a4d9d12ca600 with Priority: HIGHEST for action security_group_members [ 679.627552] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 667765ac-1a17-4f77-a3e3-a4d9d12ca600 with Priority: HIGHEST for action security_group_members [ 679.627793] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-667765ac-1a17-4f77-a3e3-a4d9d12ca600 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.627915] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.627979] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.628389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.628889] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.628889] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.628889] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.628889] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.629190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.629190] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('667765ac-1a17-4f77-a3e3-a4d9d12ca600',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.705218] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.705218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.705218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.705218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.705218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.705218] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.705218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.705218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.705218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.705218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.705218] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 is going to be updated. [ 679.732914] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.733082] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.733151] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.733360] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.733506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.742095] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 in Status: IN_PROGRESS for 2s [ 680.044287] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-669 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.044498] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.044694] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.045039] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.045331] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.045494] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.045611] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.045842] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.046025] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.046221] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 680.046334] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 680.046441] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 680.046547] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 680.046654] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 680.046757] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 680.046887] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 680.066033] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 680.066033] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 680.066033] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 680.066033] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.066033] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-0e881a0f-2c6d-43ba-ad4e-bc9ce172d429 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.066033] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-0e881a0f-2c6d-43ba-ad4e-bc9ce172d429" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.066033] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-0e881a0f-2c6d-43ba-ad4e-bc9ce172d429" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.066033] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-0e881a0f-2c6d-43ba-ad4e-bc9ce172d429" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.066033] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e881a0f-2c6d-43ba-ad4e-bc9ce172d429',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.131480] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.131480] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.131628] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.131831] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.131942] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.132158] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.132280] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.132378] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.132552] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.132633] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.132723] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 667765ac-1a17-4f77-a3e3-a4d9d12ca600 already deleted. [ 680.132802] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.516488] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff280f19-627b-45ca-afac-7d9154581e89 in Status: SUCCESS [ 680.517375] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.564659] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 in Status: SUCCESS [ 680.564945] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.565140] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.565366] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.565559] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.565696] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.565767] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.565927] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.566332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.566332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.566332] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16fadac6-f5a2-4997-b67b-221b3b4e45a8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.569057] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.569281] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.569434] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.569683] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.569842] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.570020] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 0e881a0f-2c6d-43ba-ad4e-bc9ce172d429 not found, creating... [ 680.570286] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.570712] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.570933] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.571852] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.572360] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.572486] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.572654] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.572807] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.573110] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.573390] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.573581] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 0e881a0f-2c6d-43ba-ad4e-bc9ce172d429 is going to be created. [ 680.597665] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.597665] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.597665] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.597665] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.597665] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.597665] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-0e881a0f-2c6d-43ba-ad4e-bc9ce172d429" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.080360] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16fadac6-f5a2-4997-b67b-221b3b4e45a8 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.080529] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.080613] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.080838] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.081014] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.081142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.081190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.081330] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.081419] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.081508] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.081679] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16fadac6-f5a2-4997-b67b-221b3b4e45a8 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.081779] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.081840] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.082046] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.082139] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.082216] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.082279] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.082418] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.082493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.082572] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.082661] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16fadac6-f5a2-4997-b67b-221b3b4e45a8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.497392] env[70013]: INFO networking_nsxv3.common.synchronization [req-2282cce1-55ac-4c4f-9b3e-4d6732717da4 req-cb343c21-9529-47e7-a71c-9d3489526322 service nova] Enqueued Resource ID: 667765ac-1a17-4f77-a3e3-a4d9d12ca600 with Priority: HIGHEST for action security_group_rules [ 681.497533] env[70013]: INFO networking_nsxv3.common.synchronization [req-2282cce1-55ac-4c4f-9b3e-4d6732717da4 req-cb343c21-9529-47e7-a71c-9d3489526322 service nova] Enqueued Resource ID: 667765ac-1a17-4f77-a3e3-a4d9d12ca600 with Priority: HIGHEST for action security_group_members [ 681.497689] env[70013]: INFO networking_nsxv3.common.synchronization [req-2282cce1-55ac-4c4f-9b3e-4d6732717da4 req-cb343c21-9529-47e7-a71c-9d3489526322 service nova] Enqueued Resource ID: 0e881a0f-2c6d-43ba-ad4e-bc9ce172d429 with Priority: HIGHEST for action port [ 681.498165] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 667765ac-1a17-4f77-a3e3-a4d9d12ca600 with Priority: HIGHEST for action security_group_rules [ 681.498303] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 667765ac-1a17-4f77-a3e3-a4d9d12ca600 with Priority: HIGHEST for action security_group_members [ 681.498403] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e881a0f-2c6d-43ba-ad4e-bc9ce172d429 with Priority: HIGHEST for action port [ 681.498900] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-667765ac-1a17-4f77-a3e3-a4d9d12ca600 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.499119] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.499945] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.499945] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.499945] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('667765ac-1a17-4f77-a3e3-a4d9d12ca600',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.500950] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-667765ac-1a17-4f77-a3e3-a4d9d12ca600 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.500950] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.500950] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.500950] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.501194] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.501341] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.501411] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.501566] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.501657] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.501774] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('667765ac-1a17-4f77-a3e3-a4d9d12ca600',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.504437] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e881a0f-2c6d-43ba-ad4e-bc9ce172d429 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.504581] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e881a0f-2c6d-43ba-ad4e-bc9ce172d429" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.504850] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e881a0f-2c6d-43ba-ad4e-bc9ce172d429" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.504850] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e881a0f-2c6d-43ba-ad4e-bc9ce172d429" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.504963] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e881a0f-2c6d-43ba-ad4e-bc9ce172d429',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.585539] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16fadac6-f5a2-4997-b67b-221b3b4e45a8: rpc.has_security_group_logging(os_id): False [ 681.610558] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.611029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.611029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.611184] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.611384] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.611842] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.611842] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.612069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.612211] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.612987] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.612987] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.612987] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.612987] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.612987] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.614021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.614021] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.614021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.614021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.616785] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.616785] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.616785] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 is going to be updated. [ 681.677563] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.677780] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.677780] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.678366] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.678366] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.693325] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 in Status: IN_PROGRESS for 2s [ 681.752635] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 in Status: SUCCESS [ 681.752635] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 deletion is rescheduled due to dependency. [ 681.752635] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.008458] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('667765ac-1a17-4f77-a3e3-a4d9d12ca600',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.014507] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-667765ac-1a17-4f77-a3e3-a4d9d12ca600 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.014507] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.014507] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e881a0f-2c6d-43ba-ad4e-bc9ce172d429 with status ACTIVE [ 682.014507] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.014507] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.014507] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.014507] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.014507] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.014507] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.014507] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.014507] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.014507] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.014507] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.014507] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.015056] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.015056] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.015056] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.015056] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.015056] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e881a0f-2c6d-43ba-ad4e-bc9ce172d429 is going to be updated. [ 682.034568] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.034721] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.034787] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.035020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.035163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.035342] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e881a0f-2c6d-43ba-ad4e-bc9ce172d429" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.122432] env[70013]: INFO networking_nsxv3.common.synchronization [None req-7c3539ed-dfa4-4888-9c85-b37b43547a2f None None] Enqueued Resource ID: e2d266d0-15c3-45a9-a2a3-eb0d43491eff with Priority: HIGHEST for action port [ 682.123619] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2d266d0-15c3-45a9-a2a3-eb0d43491eff with Priority: HIGHEST for action port [ 682.123619] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2d266d0-15c3-45a9-a2a3-eb0d43491eff taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.123692] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2d266d0-15c3-45a9-a2a3-eb0d43491eff" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.123781] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2d266d0-15c3-45a9-a2a3-eb0d43491eff" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.124811] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2d266d0-15c3-45a9-a2a3-eb0d43491eff" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.124923] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2d266d0-15c3-45a9-a2a3-eb0d43491eff',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.510226] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('667765ac-1a17-4f77-a3e3-a4d9d12ca600',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.627413] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e2d266d0-15c3-45a9-a2a3-eb0d43491eff [ 682.628036] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.628437] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.628623] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.629127] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.629347] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.629552] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e2d266d0-15c3-45a9-a2a3-eb0d43491eff already deleted. [ 682.629790] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2d266d0-15c3-45a9-a2a3-eb0d43491eff" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.742439] env[70013]: INFO networking_nsxv3.common.synchronization [req-10eb92e6-791a-4740-83c8-cf7e73be4011 req-f56d3610-c516-45eb-a07c-2d77334d6d67 tempest-ServerMetadataNegativeTestJSON-1247764260 tempest-ServerMetadataNegativeTestJSON-1247764260-project-member] Enqueued Resource ID: 06e430a7-fc6c-41b2-a61d-37124a285ded with Priority: HIGHEST for action security_group_members [ 682.742575] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e430a7-fc6c-41b2-a61d-37124a285ded with Priority: HIGHEST for action security_group_members [ 682.742885] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e430a7-fc6c-41b2-a61d-37124a285ded taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.743031] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.743362] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.743776] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.743776] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.743916] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.743916] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.744083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.744173] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.744268] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e430a7-fc6c-41b2-a61d-37124a285ded',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.013419] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.013646] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.013646] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.017540] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.017540] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.017540] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 667765ac-1a17-4f77-a3e3-a4d9d12ca600 is going to be created. [ 683.036840] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.037063] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.037063] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.040022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.040022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.045968] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 667765ac-1a17-4f77-a3e3-a4d9d12ca600 in Status: UNINITIALIZED for 2s [ 683.246541] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.246691] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.247065] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.247065] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.247236] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.247446] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.247546] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.247631] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.247808] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.251028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.251028] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e430a7-fc6c-41b2-a61d-37124a285ded already deleted. [ 683.251028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.706798] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 in Status: SUCCESS [ 683.707121] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.895182] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-744 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.895182] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-744" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.895182] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-744" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.895182] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-744" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.895182] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.895182] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.895182] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.895182] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.895182] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.896322] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 683.897062] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 683.897312] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 683.897689] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 683.897921] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 683.898248] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 683.900793] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 683.916946] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 683.917335] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 683.917560] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 683.917833] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-744" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.918260] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-3b22879c-7b2b-4ab9-9749-21a544891657 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.919560] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-3b22879c-7b2b-4ab9-9749-21a544891657" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.919560] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-3b22879c-7b2b-4ab9-9749-21a544891657" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.919560] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-3b22879c-7b2b-4ab9-9749-21a544891657" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.919560] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b22879c-7b2b-4ab9-9749-21a544891657',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.013245] env[70013]: INFO networking_nsxv3.common.synchronization [None req-84f1ef8a-dfe7-49e6-9239-0156fa7c472d None None] Enqueued Resource ID: 3ceed376-e8e2-497e-b2a2-4e13bf20506b with Priority: HIGHEST for action port [ 684.013245] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ceed376-e8e2-497e-b2a2-4e13bf20506b with Priority: HIGHEST for action port [ 684.013870] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ceed376-e8e2-497e-b2a2-4e13bf20506b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.014230] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ceed376-e8e2-497e-b2a2-4e13bf20506b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.014479] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ceed376-e8e2-497e-b2a2-4e13bf20506b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.014966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ceed376-e8e2-497e-b2a2-4e13bf20506b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.015233] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ceed376-e8e2-497e-b2a2-4e13bf20506b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.423400] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.423648] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.423724] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.424018] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.424178] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.424342] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 3b22879c-7b2b-4ab9-9749-21a544891657 not found, creating... [ 684.424601] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.424759] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.424878] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.425112] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.425253] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.425532] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.425687] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.425806] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.426172] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.426394] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.426555] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 3b22879c-7b2b-4ab9-9749-21a544891657 is going to be created. [ 684.448195] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.448195] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.448195] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.448195] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.448195] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.448195] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-3b22879c-7b2b-4ab9-9749-21a544891657" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.590720] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3ceed376-e8e2-497e-b2a2-4e13bf20506b [ 684.590720] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.590720] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.590720] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.590720] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.590720] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.590720] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3ceed376-e8e2-497e-b2a2-4e13bf20506b already deleted. [ 684.590720] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ceed376-e8e2-497e-b2a2-4e13bf20506b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.055238] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 667765ac-1a17-4f77-a3e3-a4d9d12ca600 in Status: SUCCESS [ 685.055631] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.055631] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.055825] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.056058] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.056182] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.056246] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.056405] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.056489] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.056958] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.056958] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('667765ac-1a17-4f77-a3e3-a4d9d12ca600',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.359992] env[70013]: INFO networking_nsxv3.common.synchronization [req-10eb92e6-791a-4740-83c8-cf7e73be4011 req-3036e681-0d64-43af-bf23-bef593d4ee32 service nova] Enqueued Resource ID: 06e430a7-fc6c-41b2-a61d-37124a285ded with Priority: HIGHEST for action security_group_rules [ 685.360214] env[70013]: INFO networking_nsxv3.common.synchronization [req-10eb92e6-791a-4740-83c8-cf7e73be4011 req-3036e681-0d64-43af-bf23-bef593d4ee32 service nova] Enqueued Resource ID: 06e430a7-fc6c-41b2-a61d-37124a285ded with Priority: HIGHEST for action security_group_members [ 685.360358] env[70013]: INFO networking_nsxv3.common.synchronization [req-10eb92e6-791a-4740-83c8-cf7e73be4011 req-3036e681-0d64-43af-bf23-bef593d4ee32 service nova] Enqueued Resource ID: 3b22879c-7b2b-4ab9-9749-21a544891657 with Priority: HIGHEST for action port [ 685.360820] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e430a7-fc6c-41b2-a61d-37124a285ded with Priority: HIGHEST for action security_group_rules [ 685.360820] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e430a7-fc6c-41b2-a61d-37124a285ded with Priority: HIGHEST for action security_group_members [ 685.360820] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b22879c-7b2b-4ab9-9749-21a544891657 with Priority: HIGHEST for action port [ 685.363215] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06e430a7-fc6c-41b2-a61d-37124a285ded taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.363357] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.363429] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.363758] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.363852] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06e430a7-fc6c-41b2-a61d-37124a285ded',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.364763] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e430a7-fc6c-41b2-a61d-37124a285ded taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.365275] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.365275] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.365275] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.365399] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.365399] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.365479] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.365626] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.365680] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.365804] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e430a7-fc6c-41b2-a61d-37124a285ded',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.369483] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b22879c-7b2b-4ab9-9749-21a544891657 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.369712] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b22879c-7b2b-4ab9-9749-21a544891657" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.369712] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b22879c-7b2b-4ab9-9749-21a544891657" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.369918] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b22879c-7b2b-4ab9-9749-21a544891657" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.369949] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b22879c-7b2b-4ab9-9749-21a544891657',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.559195] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-667765ac-1a17-4f77-a3e3-a4d9d12ca600 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.559387] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.559474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.559713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.559889] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.559995] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.560087] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.560250] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.560350] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.563713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.563713] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-667765ac-1a17-4f77-a3e3-a4d9d12ca600 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.563713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.563713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.563713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.563713] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.563713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.563713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.563713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.563713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.563713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.563713] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('667765ac-1a17-4f77-a3e3-a4d9d12ca600',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.872649] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06e430a7-fc6c-41b2-a61d-37124a285ded',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.873419] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e430a7-fc6c-41b2-a61d-37124a285ded taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.873419] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.873623] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b22879c-7b2b-4ab9-9749-21a544891657 with status ACTIVE [ 685.873804] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.874943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.874943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.874943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.874943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.875144] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.875257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.875257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.875421] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.875503] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.875689] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.875855] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.875855] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.875980] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.876067] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.876150] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b22879c-7b2b-4ab9-9749-21a544891657 is going to be updated. [ 685.909643] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.909777] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.909853] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.910093] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.910277] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.910453] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b22879c-7b2b-4ab9-9749-21a544891657" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.065808] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 667765ac-1a17-4f77-a3e3-a4d9d12ca600: rpc.has_security_group_logging(os_id): False [ 686.085273] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.085656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.085656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.085656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.085656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.085899] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.085991] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.086060] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.086311] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.086311] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.086446] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.086537] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.086594] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.086735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.086810] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.086985] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.087765] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.087841] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.088133] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.088247] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.088339] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 667765ac-1a17-4f77-a3e3-a4d9d12ca600 is going to be created. [ 686.145660] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.145978] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.146529] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.146529] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.146717] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.159023] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 667765ac-1a17-4f77-a3e3-a4d9d12ca600 in Status: IN_PROGRESS for 2s [ 686.374763] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06e430a7-fc6c-41b2-a61d-37124a285ded',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.880083] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.880283] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.880360] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.880592] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.880695] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.880801] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e430a7-fc6c-41b2-a61d-37124a285ded is going to be created. [ 686.903426] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.903583] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.903650] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.903918] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.904094] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.914530] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e430a7-fc6c-41b2-a61d-37124a285ded in Status: UNINITIALIZED for 2s [ 687.025526] env[70013]: INFO networking_nsxv3.common.synchronization [req-153eb80c-74c4-49a7-8f37-4b1818908250 req-58da0937-69d7-4d0c-84ea-9ee96c2512a3 tempest-ServersAdminTestJSON-1183835690 tempest-ServersAdminTestJSON-1183835690-project-member] Enqueued Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_members [ 687.026536] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_members [ 687.026536] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7abade-e912-4196-b558-4a6d4ece9b29 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.026536] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.026536] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.026536] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.026716] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.026716] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.026791] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.026936] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.027028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.027124] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.419710] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-713 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.421237] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-713" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.421237] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-713" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.422466] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-713" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.422466] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.422466] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.422619] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.422760] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.422886] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.425147] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 687.425377] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 687.425425] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 687.425530] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 687.425653] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 687.425764] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 687.425918] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 687.443611] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 687.443790] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 687.443930] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 687.444126] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-713" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.444441] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-2e160e96-59d2-4391-adfe-0ebb379762cd taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.444613] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-2e160e96-59d2-4391-adfe-0ebb379762cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.444733] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-2e160e96-59d2-4391-adfe-0ebb379762cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.445093] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-2e160e96-59d2-4391-adfe-0ebb379762cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.445240] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e160e96-59d2-4391-adfe-0ebb379762cd',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.529954] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.949473] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.949473] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.949473] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.949473] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.951119] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.951119] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 2e160e96-59d2-4391-adfe-0ebb379762cd not found, creating... [ 687.951119] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.951119] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.951119] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.951119] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.951119] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.951119] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.953978] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.954175] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.955142] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.955142] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.955142] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 2e160e96-59d2-4391-adfe-0ebb379762cd is going to be created. [ 687.974255] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.974527] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.974677] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.975103] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.975446] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.975771] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-2e160e96-59d2-4391-adfe-0ebb379762cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.033699] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.174089] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 667765ac-1a17-4f77-a3e3-a4d9d12ca600 in Status: SUCCESS [ 688.174089] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.541624] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.541924] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.541924] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.541986] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.542457] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.542457] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 is going to be updated. [ 688.572024] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.572024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.572024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.572024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.572024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.582339] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: IN_PROGRESS for 2s [ 688.913093] env[70013]: INFO networking_nsxv3.common.synchronization [req-153eb80c-74c4-49a7-8f37-4b1818908250 req-2c0f59bc-7057-4dcb-b47d-87e2d834914e service nova] Enqueued Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_rules [ 688.913535] env[70013]: INFO networking_nsxv3.common.synchronization [req-153eb80c-74c4-49a7-8f37-4b1818908250 req-2c0f59bc-7057-4dcb-b47d-87e2d834914e service nova] Enqueued Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_members [ 688.913535] env[70013]: INFO networking_nsxv3.common.synchronization [req-153eb80c-74c4-49a7-8f37-4b1818908250 req-2c0f59bc-7057-4dcb-b47d-87e2d834914e service nova] Enqueued Resource ID: 2e160e96-59d2-4391-adfe-0ebb379762cd with Priority: HIGHEST for action port [ 688.915463] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_rules [ 688.916579] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_members [ 688.916579] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e160e96-59d2-4391-adfe-0ebb379762cd with Priority: HIGHEST for action port [ 688.923056] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a7abade-e912-4196-b558-4a6d4ece9b29 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.923274] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.923380] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.923613] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.923702] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.925033] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7abade-e912-4196-b558-4a6d4ece9b29 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.925167] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.934205] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e160e96-59d2-4391-adfe-0ebb379762cd taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.934205] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e160e96-59d2-4391-adfe-0ebb379762cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.934205] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e160e96-59d2-4391-adfe-0ebb379762cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.934205] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e160e96-59d2-4391-adfe-0ebb379762cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.934205] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e160e96-59d2-4391-adfe-0ebb379762cd',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.941670] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e430a7-fc6c-41b2-a61d-37124a285ded in Status: SUCCESS [ 688.941934] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.942170] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.942450] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.942685] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.942868] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.942960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.943221] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.943360] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.944552] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.944552] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06e430a7-fc6c-41b2-a61d-37124a285ded',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.178252] env[70013]: INFO networking_nsxv3.common.synchronization [None req-c8b25574-fe3c-4d87-b5e9-f7a4974b59fd None None] Enqueued Resource ID: e40bcb30-101b-4882-8d7e-29401ebd3ad6 with Priority: HIGHEST for action port [ 689.178522] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e40bcb30-101b-4882-8d7e-29401ebd3ad6 with Priority: HIGHEST for action port [ 689.179152] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-e40bcb30-101b-4882-8d7e-29401ebd3ad6 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.179268] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e40bcb30-101b-4882-8d7e-29401ebd3ad6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.179332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e40bcb30-101b-4882-8d7e-29401ebd3ad6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.179597] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e40bcb30-101b-4882-8d7e-29401ebd3ad6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.179673] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e40bcb30-101b-4882-8d7e-29401ebd3ad6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.434974] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7abade-e912-4196-b558-4a6d4ece9b29 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.438071] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.438071] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e160e96-59d2-4391-adfe-0ebb379762cd with status ACTIVE [ 689.438071] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.438071] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.438071] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.438071] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.438071] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.438504] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.438682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.438841] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.439089] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.439397] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.439674] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.439829] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.439925] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.440111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.440190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.440276] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e160e96-59d2-4391-adfe-0ebb379762cd is going to be updated. [ 689.445724] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e430a7-fc6c-41b2-a61d-37124a285ded taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.445937] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.446024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.446230] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.446404] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.446504] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.446571] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.446731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.446817] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.447213] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.447213] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e430a7-fc6c-41b2-a61d-37124a285ded taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.447213] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.447213] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.447401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.447467] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.447555] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.447615] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.447758] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.447834] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.447915] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.448018] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06e430a7-fc6c-41b2-a61d-37124a285ded',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.462514] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.462741] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.462741] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.462936] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.463132] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.463297] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e160e96-59d2-4391-adfe-0ebb379762cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.682112] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e40bcb30-101b-4882-8d7e-29401ebd3ad6 [ 689.682430] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.682430] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.682556] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.682677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.682782] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.682878] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e40bcb30-101b-4882-8d7e-29401ebd3ad6 already deleted. [ 689.682963] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e40bcb30-101b-4882-8d7e-29401ebd3ad6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.950405] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06e430a7-fc6c-41b2-a61d-37124a285ded: rpc.has_security_group_logging(os_id): False [ 689.970614] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.970614] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.970614] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.971350] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.971350] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.971350] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.971350] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.971350] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.971899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.971899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.971899] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.971899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.972055] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.973025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.973025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.973025] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.973025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.973025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.973025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.973025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.973025] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06e430a7-fc6c-41b2-a61d-37124a285ded is going to be created. [ 690.029220] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.029388] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.029529] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.029682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.029880] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.041032] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e430a7-fc6c-41b2-a61d-37124a285ded in Status: IN_PROGRESS for 2s [ 690.597062] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: SUCCESS [ 690.597458] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.598105] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.598360] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.598557] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.599187] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.599187] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.599187] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.599187] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.599187] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.102795] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.358112] env[70013]: INFO networking_nsxv3.common.synchronization [None req-a6ebc24e-7c87-47a8-a6ba-239b17209317 None None] Enqueued Resource ID: db9e83c8-4d3c-4d82-87c2-a595461a9fdc with Priority: HIGHEST for action port [ 691.358433] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db9e83c8-4d3c-4d82-87c2-a595461a9fdc with Priority: HIGHEST for action port [ 691.362782] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-db9e83c8-4d3c-4d82-87c2-a595461a9fdc taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.362916] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db9e83c8-4d3c-4d82-87c2-a595461a9fdc" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.362989] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db9e83c8-4d3c-4d82-87c2-a595461a9fdc" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.363297] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db9e83c8-4d3c-4d82-87c2-a595461a9fdc" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.363381] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db9e83c8-4d3c-4d82-87c2-a595461a9fdc',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.608991] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.869378] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db9e83c8-4d3c-4d82-87c2-a595461a9fdc [ 691.869378] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.869378] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.869378] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.870890] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.870890] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.870890] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db9e83c8-4d3c-4d82-87c2-a595461a9fdc already deleted. [ 691.870890] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db9e83c8-4d3c-4d82-87c2-a595461a9fdc" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.017614] env[70013]: INFO networking_nsxv3.common.synchronization [req-6877f9d3-19d9-40c3-9940-10e23bd854cc req-40108753-583c-44bd-8541-b90c3c18eb04 tempest-DeleteServersAdminTestJSON-1322678731 tempest-DeleteServersAdminTestJSON-1322678731-project-member] Enqueued Resource ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 with Priority: HIGHEST for action security_group_members [ 692.018238] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 with Priority: HIGHEST for action security_group_members [ 692.020018] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16fadac6-f5a2-4997-b67b-221b3b4e45a8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.020018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.020018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.020018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.020018] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.020018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.020018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.020018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.020018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.020018] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16fadac6-f5a2-4997-b67b-221b3b4e45a8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.055129] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06e430a7-fc6c-41b2-a61d-37124a285ded in Status: SUCCESS [ 692.055419] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.119385] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.119683] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.119720] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.120029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.120172] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.120317] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 is going to be updated. [ 692.146818] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.146899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.147410] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.147410] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.147535] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.156815] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: IN_PROGRESS for 2s [ 692.522015] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.522212] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.522253] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.522474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.522569] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.522766] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.523060] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.523060] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.523182] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.523211] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.523291] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 is going to be updated. [ 692.551024] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.551024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.551024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.551024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.551024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.556342] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 in Status: IN_PROGRESS for 2s [ 693.057621] env[70013]: INFO networking_nsxv3.common.synchronization [req-ba9356ec-3b95-460c-9f23-85b55713c7d9 req-d3e606f3-4808-4564-8a26-e8f48139a4f5 tempest-ImagesTestJSON-851757871 tempest-ImagesTestJSON-851757871-project-member] Enqueued Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 693.057621] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 693.058423] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.058423] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.058423] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.058423] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.058703] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.058773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.058816] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.059230] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.060491] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.061520] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.287422] env[70013]: INFO networking_nsxv3.common.synchronization [req-53591ce8-7b34-49f0-a497-e14010dc2509 req-4b8372ea-7142-4165-b866-32016b546084 tempest-FloatingIPsAssociationTestJSON-1070439366 tempest-FloatingIPsAssociationTestJSON-1070439366-project-member] Enqueued Resource ID: ff280f19-627b-45ca-afac-7d9154581e89 with Priority: HIGHEST for action security_group_members [ 693.289041] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff280f19-627b-45ca-afac-7d9154581e89 with Priority: HIGHEST for action security_group_members [ 693.289041] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff280f19-627b-45ca-afac-7d9154581e89 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.289041] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.289041] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.289041] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.289041] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.289462] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.289462] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.291042] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.291042] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.291042] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff280f19-627b-45ca-afac-7d9154581e89',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.567900] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.567900] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.567900] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.567900] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.567900] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.567900] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.567900] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.567900] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.567900] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.567900] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.567900] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 is going to be updated. [ 693.592029] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.592029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.592029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.592029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.592029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.599295] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: IN_PROGRESS for 2s [ 693.757541] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-875 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.757742] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-875" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.757867] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-875" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.758162] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-875" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.758428] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.758589] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.758735] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.758968] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.759136] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.759353] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 693.759467] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 693.759577] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 693.759686] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 693.759814] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 693.759901] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 693.760054] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 693.777392] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 693.777639] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 693.777813] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 693.778104] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-875" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.778490] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-dbdfc4ab-6655-403a-8fa4-9d2cd2e84728 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.778692] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-dbdfc4ab-6655-403a-8fa4-9d2cd2e84728" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.778820] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-dbdfc4ab-6655-403a-8fa4-9d2cd2e84728" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.780775] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-dbdfc4ab-6655-403a-8fa4-9d2cd2e84728" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.781158] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbdfc4ab-6655-403a-8fa4-9d2cd2e84728',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.792323] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff280f19-627b-45ca-afac-7d9154581e89',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.166159] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: SUCCESS [ 694.166484] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.166689] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.166928] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.167851] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.167851] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.167851] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.167851] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.167851] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.168044] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.168044] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.284619] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.285602] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.285602] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.285602] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.285602] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.285602] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port dbdfc4ab-6655-403a-8fa4-9d2cd2e84728 not found, creating... [ 694.285866] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.289026] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.289026] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.289026] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.289026] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.289026] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.289026] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.289026] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.289026] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.289026] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.289026] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: dbdfc4ab-6655-403a-8fa4-9d2cd2e84728 is going to be created. [ 694.297192] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff280f19-627b-45ca-afac-7d9154581e89',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.308472] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.308682] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.308817] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.309177] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.309417] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.309638] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-dbdfc4ab-6655-403a-8fa4-9d2cd2e84728" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.565766] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 in Status: SUCCESS [ 694.565951] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 deletion is rescheduled due to dependency. [ 694.566088] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.670432] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7abade-e912-4196-b558-4a6d4ece9b29 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.670617] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.670661] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.670927] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.671122] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.671265] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.671325] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.671435] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.671522] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.671613] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.671760] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7abade-e912-4196-b558-4a6d4ece9b29 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.671853] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.671912] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.672071] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.672208] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.672298] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.672359] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.672496] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.672637] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.672685] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.672744] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.796968] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.797147] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.797220] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.797438] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.797531] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.797630] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff280f19-627b-45ca-afac-7d9154581e89 is going to be updated. [ 694.823202] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.827022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.827022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.827022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.827022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.832165] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff280f19-627b-45ca-afac-7d9154581e89 in Status: IN_PROGRESS for 2s [ 695.177816] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a7abade-e912-4196-b558-4a6d4ece9b29: rpc.has_security_group_logging(os_id): False [ 695.196622] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.196842] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.196932] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.197394] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.197512] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.197818] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.197945] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.198048] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.198265] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.198372] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.202035] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.202035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.202035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.202035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.202035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.202035] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.202035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.202035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.202035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.202035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.202035] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 is going to be updated. [ 695.290298] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.290298] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.290298] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.290298] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.290298] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.302988] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: IN_PROGRESS for 2s [ 695.312266] env[70013]: INFO networking_nsxv3.common.synchronization [req-ba9356ec-3b95-460c-9f23-85b55713c7d9 req-db1eeb32-4f49-44d6-abbb-7e0e7b2fdf23 service nova] Enqueued Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_rules [ 695.312266] env[70013]: INFO networking_nsxv3.common.synchronization [req-ba9356ec-3b95-460c-9f23-85b55713c7d9 req-db1eeb32-4f49-44d6-abbb-7e0e7b2fdf23 service nova] Enqueued Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 695.312266] env[70013]: INFO networking_nsxv3.common.synchronization [req-ba9356ec-3b95-460c-9f23-85b55713c7d9 req-db1eeb32-4f49-44d6-abbb-7e0e7b2fdf23 service nova] Enqueued Resource ID: dbdfc4ab-6655-403a-8fa4-9d2cd2e84728 with Priority: HIGHEST for action port [ 695.312805] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_rules [ 695.312934] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 695.313391] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbdfc4ab-6655-403a-8fa4-9d2cd2e84728 with Priority: HIGHEST for action port [ 695.314725] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.314725] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.314725] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.316250] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.316250] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.317386] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.317386] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.317481] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbdfc4ab-6655-403a-8fa4-9d2cd2e84728 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.317554] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbdfc4ab-6655-403a-8fa4-9d2cd2e84728" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.317584] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbdfc4ab-6655-403a-8fa4-9d2cd2e84728" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.318341] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbdfc4ab-6655-403a-8fa4-9d2cd2e84728" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.318341] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbdfc4ab-6655-403a-8fa4-9d2cd2e84728',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.513696] env[70013]: INFO networking_nsxv3.common.synchronization [req-1e22d32e-78f4-4f7a-b0ce-3a3ab4d293d0 req-c80ebcc9-8f84-4fa9-9cb9-491c5df5a4a1 tempest-ServerActionsTestJSON-1661939768 tempest-ServerActionsTestJSON-1661939768-project-member] Enqueued Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGHEST for action security_group_members [ 695.513918] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGHEST for action security_group_members [ 695.514261] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.514365] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.514423] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.514676] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.514834] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.514937] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.514997] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.516024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.516143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.516244] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.609975] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: SUCCESS [ 695.609975] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 deletion is rescheduled due to dependency. [ 695.609975] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.609975] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.609975] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.609975] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.610217] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.610217] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.610299] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.610330] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.610424] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.819427] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.819643] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.819840] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dbdfc4ab-6655-403a-8fa4-9d2cd2e84728 with status ACTIVE [ 695.820052] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.820192] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.820438] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.823030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.823030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.823030] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.823030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.823030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.823030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.823030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.823030] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.823030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.823030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.823030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.823030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.823030] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dbdfc4ab-6655-403a-8fa4-9d2cd2e84728 is going to be updated. [ 695.843429] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.844203] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.844203] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.844203] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.844203] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.844977] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbdfc4ab-6655-403a-8fa4-9d2cd2e84728" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.855884] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.856107] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-885" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.856232] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-885" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.856573] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-885" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.856877] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.857755] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.857836] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.858383] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.858679] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.859625] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 695.859880] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 695.860012] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 695.860175] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 695.860324] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 695.860462] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 695.860630] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 695.879509] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 695.879713] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 695.879858] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 695.880049] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-885" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.881134] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-4b681dd6-fab3-4812-988e-26b219b6c5c3 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.881134] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-4b681dd6-fab3-4812-988e-26b219b6c5c3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.881134] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-4b681dd6-fab3-4812-988e-26b219b6c5c3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.881134] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-4b681dd6-fab3-4812-988e-26b219b6c5c3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.881740] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b681dd6-fab3-4812-988e-26b219b6c5c3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.019219] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.019441] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.019526] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.019696] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.019783] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.019964] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.020101] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.020303] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.020303] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.020403] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.020449] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 already deleted. [ 696.020542] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.112510] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.366977] env[70013]: INFO networking_nsxv3.common.synchronization [req-647ebfca-d83c-4831-90c7-7844ede1aa7a req-08aa929c-b20a-494a-b075-f414067684b6 tempest-ServerPasswordTestJSON-928370253 tempest-ServerPasswordTestJSON-928370253-project-member] Enqueued Resource ID: 667765ac-1a17-4f77-a3e3-a4d9d12ca600 with Priority: HIGHEST for action security_group_members [ 696.367543] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 667765ac-1a17-4f77-a3e3-a4d9d12ca600 with Priority: HIGHEST for action security_group_members [ 696.367876] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-667765ac-1a17-4f77-a3e3-a4d9d12ca600 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.368039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.372278] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.372539] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.372748] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.372868] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.372933] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.373163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.373235] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.373334] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('667765ac-1a17-4f77-a3e3-a4d9d12ca600',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.384600] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.384814] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.384932] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.385249] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.385402] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.385570] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 4b681dd6-fab3-4812-988e-26b219b6c5c3 not found, creating... [ 696.385850] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.386115] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.386231] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.386461] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.386595] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.386921] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.389356] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.389597] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.390439] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.390439] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.390439] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 4b681dd6-fab3-4812-988e-26b219b6c5c3 is going to be created. [ 696.413504] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.413767] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.413909] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.416093] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.418826] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.418826] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-4b681dd6-fab3-4812-988e-26b219b6c5c3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.614360] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.843231] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff280f19-627b-45ca-afac-7d9154581e89 in Status: SUCCESS [ 696.843437] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.877024] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.877024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.877024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.877024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.877024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.877024] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.877024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.877024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.877488] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.877488] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.877488] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 667765ac-1a17-4f77-a3e3-a4d9d12ca600 is going to be updated. [ 696.907408] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.907604] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.907675] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.907899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.908077] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.917209] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 667765ac-1a17-4f77-a3e3-a4d9d12ca600 in Status: IN_PROGRESS for 2s [ 697.118438] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.118438] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.118438] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.118438] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.118438] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.118438] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 is going to be updated. [ 697.148469] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.148615] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.148676] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.148909] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.149073] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.157724] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: IN_PROGRESS for 2s [ 697.269058] env[70013]: INFO networking_nsxv3.common.synchronization [req-1e22d32e-78f4-4f7a-b0ce-3a3ab4d293d0 req-9898952f-4370-41e9-ac05-6def3889172a service nova] Enqueued Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGHEST for action security_group_rules [ 697.269058] env[70013]: INFO networking_nsxv3.common.synchronization [req-1e22d32e-78f4-4f7a-b0ce-3a3ab4d293d0 req-9898952f-4370-41e9-ac05-6def3889172a service nova] Enqueued Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGHEST for action security_group_members [ 697.269058] env[70013]: INFO networking_nsxv3.common.synchronization [req-1e22d32e-78f4-4f7a-b0ce-3a3ab4d293d0 req-9898952f-4370-41e9-ac05-6def3889172a service nova] Enqueued Resource ID: 4b681dd6-fab3-4812-988e-26b219b6c5c3 with Priority: HIGHEST for action port [ 697.269058] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGHEST for action security_group_rules [ 697.269058] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGHEST for action security_group_members [ 697.269058] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b681dd6-fab3-4812-988e-26b219b6c5c3 with Priority: HIGHEST for action port [ 697.269058] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.269058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.270116] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.271237] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.271237] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.274366] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.274504] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.274575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.274779] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.274958] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.275090] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.275158] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.275371] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.275501] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.275647] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.276735] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b681dd6-fab3-4812-988e-26b219b6c5c3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.276905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b681dd6-fab3-4812-988e-26b219b6c5c3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.276905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b681dd6-fab3-4812-988e-26b219b6c5c3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.277076] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b681dd6-fab3-4812-988e-26b219b6c5c3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.277169] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b681dd6-fab3-4812-988e-26b219b6c5c3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.320597] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: SUCCESS [ 697.320877] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.694411] env[70013]: INFO networking_nsxv3.common.synchronization [req-deebd809-0e5e-497a-a8ad-ca9fe220b364 req-b36d9b96-dadf-48e1-81b3-66a9f499fe69 tempest-ImagesOneServerNegativeTestJSON-165560685 tempest-ImagesOneServerNegativeTestJSON-165560685-project-member] Enqueued Resource ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 with Priority: HIGHEST for action security_group_members [ 697.697081] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 with Priority: HIGHEST for action security_group_members [ 697.697081] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d98818b-c2c5-4242-8897-fe65d03027a5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.697081] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.697081] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.697081] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.697081] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.697081] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.697081] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.697081] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.697081] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.697081] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d98818b-c2c5-4242-8897-fe65d03027a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.778640] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.778829] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.779126] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.780254] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b681dd6-fab3-4812-988e-26b219b6c5c3 with status ACTIVE [ 697.780443] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.780568] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.780665] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.780910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.781015] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.781185] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.781282] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.781352] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.781506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.781582] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.781766] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.781874] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.781938] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.782482] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.782602] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.782849] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b681dd6-fab3-4812-988e-26b219b6c5c3 is going to be updated. [ 697.805629] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.806179] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.806263] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.806472] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.806609] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.806765] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b681dd6-fab3-4812-988e-26b219b6c5c3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.198990] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.199172] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.199246] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.199474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.199607] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.199778] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.199878] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.199941] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.200108] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.200185] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.200272] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 is going to be updated. [ 698.255669] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.255669] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.255669] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.255849] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.255930] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.272267] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 in Status: IN_PROGRESS for 2s [ 698.285093] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.790630] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.790968] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.791032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.791264] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.791360] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.791472] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 is going to be created. [ 698.814956] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.815170] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.815249] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.815509] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.815666] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.825835] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 in Status: UNINITIALIZED for 2s [ 698.927893] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 667765ac-1a17-4f77-a3e3-a4d9d12ca600 in Status: SUCCESS [ 698.928179] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 667765ac-1a17-4f77-a3e3-a4d9d12ca600 deletion is rescheduled due to dependency. [ 698.928357] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.172629] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: SUCCESS [ 699.173232] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.173232] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.173368] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.173471] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.173601] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.173655] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.173798] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.173882] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.173968] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.174072] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.642324] env[70013]: INFO networking_nsxv3.common.synchronization [req-e3578fc1-7c65-499b-8859-80b834f3d8a9 req-5cb8c48b-9f1c-4b88-8811-37e39eb3a2c8 tempest-ServerMetadataNegativeTestJSON-1247764260 tempest-ServerMetadataNegativeTestJSON-1247764260-project-member] Enqueued Resource ID: 06e430a7-fc6c-41b2-a61d-37124a285ded with Priority: HIGHEST for action security_group_members [ 699.642909] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e430a7-fc6c-41b2-a61d-37124a285ded with Priority: HIGHEST for action security_group_members [ 699.643233] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-06e430a7-fc6c-41b2-a61d-37124a285ded taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.643371] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.643438] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.645433] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.645433] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.645433] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.645433] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.645433] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.645433] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.645433] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06e430a7-fc6c-41b2-a61d-37124a285ded',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.676474] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.676622] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.676703] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.676916] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.677100] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.677203] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.677295] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.677458] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.677548] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.677636] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.678186] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.678186] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.678186] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.678186] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.678425] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.678425] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.678425] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.678532] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.678605] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.678650] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.678772] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.148024] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.148024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.148024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.148024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.148024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.148024] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.148024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.148024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.148024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.148732] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.148732] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e430a7-fc6c-41b2-a61d-37124a285ded is going to be updated. [ 700.173456] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.173456] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.173456] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.173732] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.173808] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.181660] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e430a7-fc6c-41b2-a61d-37124a285ded in Status: IN_PROGRESS for 2s [ 700.181896] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc1b714b-7da7-41dc-b21f-d8ad167c33d9: rpc.has_security_group_logging(os_id): False [ 700.200338] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.200515] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.200559] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.201461] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.201461] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.201461] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.201461] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.201461] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.201461] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.201783] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.201783] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.201885] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.201885] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.202048] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.202127] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.202306] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.202399] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.202899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.202899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.202899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.202899] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 is going to be updated. [ 700.279586] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 in Status: SUCCESS [ 700.279848] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 deletion is rescheduled due to dependency. [ 700.279935] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.295887] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.296051] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.296159] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.296347] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.296630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.310512] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: IN_PROGRESS for 2s [ 700.835762] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 in Status: SUCCESS [ 700.835945] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.836157] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.836387] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.836581] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.836699] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.836765] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.836918] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.837010] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.837105] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.837197] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.339363] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.844409] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6: rpc.has_security_group_logging(os_id): False [ 701.861257] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.861422] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.861486] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.861705] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.861805] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.862061] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.862162] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.862227] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.862378] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.862457] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.862544] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 is going to be created. [ 701.915464] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.915614] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.915693] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.915996] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.916215] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.926346] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 in Status: IN_PROGRESS for 2s [ 702.190021] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06e430a7-fc6c-41b2-a61d-37124a285ded in Status: SUCCESS [ 702.190266] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06e430a7-fc6c-41b2-a61d-37124a285ded deletion is rescheduled due to dependency. [ 702.190445] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.322419] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: SUCCESS [ 702.322683] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.858963] env[70013]: INFO networking_nsxv3.common.synchronization [req-92ab9a43-2fd6-4b4b-8ea7-7f52f4db0033 req-96bee1c5-ee6f-4516-a568-ae3614d1c44a tempest-ImagesOneServerTestJSON-841575098 tempest-ImagesOneServerTestJSON-841575098-project-member] Enqueued Resource ID: d189cef5-279a-45d3-a52a-a0fb084ee3fa with Priority: HIGHEST for action security_group_members [ 703.859238] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d189cef5-279a-45d3-a52a-a0fb084ee3fa with Priority: HIGHEST for action security_group_members [ 703.860035] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d189cef5-279a-45d3-a52a-a0fb084ee3fa taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.860035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.860035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.860035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.860035] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.860035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.861040] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.861179] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.861285] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.861369] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d189cef5-279a-45d3-a52a-a0fb084ee3fa',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.939146] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 in Status: SUCCESS [ 703.939146] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.367045] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.367045] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.367045] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.367045] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.367045] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.367045] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.367045] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.367045] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.367045] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.367045] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.367045] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d189cef5-279a-45d3-a52a-a0fb084ee3fa is going to be updated. [ 704.390827] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.391863] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.391955] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.392201] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.392351] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.403017] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d189cef5-279a-45d3-a52a-a0fb084ee3fa in Status: IN_PROGRESS for 2s [ 706.417883] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d189cef5-279a-45d3-a52a-a0fb084ee3fa in Status: SUCCESS [ 706.417883] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d189cef5-279a-45d3-a52a-a0fb084ee3fa deletion is rescheduled due to dependency. [ 706.417883] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.561077] env[70013]: INFO networking_nsxv3.common.synchronization [req-2846aa56-4eef-4cfb-be8c-05126d618886 req-84d2e48d-01bb-4e24-bb5a-955cc0f87aa5 tempest-ServersV294TestFqdnHostnames-1836307938 tempest-ServersV294TestFqdnHostnames-1836307938-project-member] Enqueued Resource ID: e4b90d0d-893d-4d8b-9c48-77a47707807a with Priority: HIGHEST for action security_group_members [ 706.561597] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4b90d0d-893d-4d8b-9c48-77a47707807a with Priority: HIGHEST for action security_group_members [ 706.561899] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4b90d0d-893d-4d8b-9c48-77a47707807a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.562311] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.562436] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.562644] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.562799] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.562906] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.563128] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.563224] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.563224] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.563398] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4b90d0d-893d-4d8b-9c48-77a47707807a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.755767] env[70013]: INFO networking_nsxv3.common.synchronization [req-829c167f-50cc-472b-94d7-848225ca6cb5 req-a3cbe714-4454-4a61-9eaf-c886088b086a tempest-AttachInterfacesV270Test-1942387806 tempest-AttachInterfacesV270Test-1942387806-project-member] Enqueued Resource ID: e99a11c8-f108-4784-aa19-9139eb46ce97 with Priority: HIGHEST for action security_group_members [ 706.756311] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e99a11c8-f108-4784-aa19-9139eb46ce97 with Priority: HIGHEST for action security_group_members [ 706.756616] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-e99a11c8-f108-4784-aa19-9139eb46ce97 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.756738] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e99a11c8-f108-4784-aa19-9139eb46ce97" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.756807] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e99a11c8-f108-4784-aa19-9139eb46ce97" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.758215] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e99a11c8-f108-4784-aa19-9139eb46ce97" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.758405] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.758518] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.758634] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.758785] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.758877] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.758974] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e99a11c8-f108-4784-aa19-9139eb46ce97',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.066567] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.066722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.066943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.067113] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.067153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.067344] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.067911] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.068038] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.068214] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.068284] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.068397] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4b90d0d-893d-4d8b-9c48-77a47707807a is going to be updated. [ 707.094948] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.095097] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.095169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.095383] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.095524] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.107185] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4b90d0d-893d-4d8b-9c48-77a47707807a in Status: IN_PROGRESS for 2s [ 707.264124] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.264124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.264124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.264124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.264124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.264124] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.264124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.264124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.264124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.264124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.264124] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e99a11c8-f108-4784-aa19-9139eb46ce97 already deleted. [ 707.264124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e99a11c8-f108-4784-aa19-9139eb46ce97" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.374242] env[70013]: INFO networking_nsxv3.common.synchronization [None req-c8bec63f-b41d-4387-94ac-7276d93b5c72 None None] Enqueued Resource ID: b3e31dae-f5fe-45f0-ad81-23803ce33315 with Priority: HIGHEST for action port [ 707.375087] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3e31dae-f5fe-45f0-ad81-23803ce33315 with Priority: HIGHEST for action port [ 707.375607] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3e31dae-f5fe-45f0-ad81-23803ce33315 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.376157] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3e31dae-f5fe-45f0-ad81-23803ce33315" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.376347] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3e31dae-f5fe-45f0-ad81-23803ce33315" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.376735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3e31dae-f5fe-45f0-ad81-23803ce33315" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.377792] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3e31dae-f5fe-45f0-ad81-23803ce33315',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.712239] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-199 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.712239] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-199" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.712239] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-199" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.712239] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-199" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.712239] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.712239] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.715177] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.718923] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.718923] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.718923] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 707.718923] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 707.718923] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 707.718923] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 707.718923] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 707.718923] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 707.718923] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 707.742548] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 707.742548] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 707.742548] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 707.742548] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-199" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.742548] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-ae7ca477-594c-47ae-a235-e80874d36402 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.742548] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-ae7ca477-594c-47ae-a235-e80874d36402" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.742548] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-ae7ca477-594c-47ae-a235-e80874d36402" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.742548] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-ae7ca477-594c-47ae-a235-e80874d36402" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.742548] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae7ca477-594c-47ae-a235-e80874d36402',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.883134] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3e31dae-f5fe-45f0-ad81-23803ce33315 [ 707.883415] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.883558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.883631] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.883863] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.883972] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.884113] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3e31dae-f5fe-45f0-ad81-23803ce33315 already deleted. [ 707.884204] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3e31dae-f5fe-45f0-ad81-23803ce33315" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.244460] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.244946] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.244946] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.245219] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.245273] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.245437] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port ae7ca477-594c-47ae-a235-e80874d36402 not found, creating... [ 708.245704] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.245861] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.245974] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.246202] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.246331] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.246607] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.246867] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.246867] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.247887] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.248085] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.248364] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: ae7ca477-594c-47ae-a235-e80874d36402 is going to be created. [ 708.267613] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.267613] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.267613] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.268825] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.268825] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.269019] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-ae7ca477-594c-47ae-a235-e80874d36402" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.040617] env[70013]: INFO networking_nsxv3.common.synchronization [req-829c167f-50cc-472b-94d7-848225ca6cb5 req-8b887a9a-a1de-43be-948a-6208c1b53ec1 service nova] Enqueued Resource ID: e99a11c8-f108-4784-aa19-9139eb46ce97 with Priority: HIGHEST for action security_group_rules [ 709.040617] env[70013]: INFO networking_nsxv3.common.synchronization [req-829c167f-50cc-472b-94d7-848225ca6cb5 req-8b887a9a-a1de-43be-948a-6208c1b53ec1 service nova] Enqueued Resource ID: e99a11c8-f108-4784-aa19-9139eb46ce97 with Priority: HIGHEST for action security_group_members [ 709.040617] env[70013]: INFO networking_nsxv3.common.synchronization [req-829c167f-50cc-472b-94d7-848225ca6cb5 req-8b887a9a-a1de-43be-948a-6208c1b53ec1 service nova] Enqueued Resource ID: ae7ca477-594c-47ae-a235-e80874d36402 with Priority: HIGHEST for action port [ 709.040617] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e99a11c8-f108-4784-aa19-9139eb46ce97 with Priority: HIGHEST for action security_group_rules [ 709.040617] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e99a11c8-f108-4784-aa19-9139eb46ce97 with Priority: HIGHEST for action security_group_members [ 709.040617] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae7ca477-594c-47ae-a235-e80874d36402 with Priority: HIGHEST for action port [ 709.040617] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e99a11c8-f108-4784-aa19-9139eb46ce97 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.040617] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e99a11c8-f108-4784-aa19-9139eb46ce97" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.041305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e99a11c8-f108-4784-aa19-9139eb46ce97" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.041305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e99a11c8-f108-4784-aa19-9139eb46ce97" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.041305] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e99a11c8-f108-4784-aa19-9139eb46ce97',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.042491] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-e99a11c8-f108-4784-aa19-9139eb46ce97 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.042600] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e99a11c8-f108-4784-aa19-9139eb46ce97" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.042674] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e99a11c8-f108-4784-aa19-9139eb46ce97" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.042967] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e99a11c8-f108-4784-aa19-9139eb46ce97" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.043139] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.043237] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.043296] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.043440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.043520] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.043614] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e99a11c8-f108-4784-aa19-9139eb46ce97',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.044659] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae7ca477-594c-47ae-a235-e80874d36402 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.044659] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae7ca477-594c-47ae-a235-e80874d36402" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.044659] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae7ca477-594c-47ae-a235-e80874d36402" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.044659] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae7ca477-594c-47ae-a235-e80874d36402" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.044892] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae7ca477-594c-47ae-a235-e80874d36402',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.117588] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4b90d0d-893d-4d8b-9c48-77a47707807a in Status: SUCCESS [ 709.117772] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4b90d0d-893d-4d8b-9c48-77a47707807a deletion is rescheduled due to dependency. [ 709.117977] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.543489] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-e99a11c8-f108-4784-aa19-9139eb46ce97 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.543489] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e99a11c8-f108-4784-aa19-9139eb46ce97" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.547137] env[70013]: INFO networking_nsxv3.common.synchronization [None req-a69b81dd-a059-4cfc-89ad-62c614454443 None None] Enqueued Resource ID: 5a5a9b9e-1f82-415e-a875-f7df5e59ecf5 with Priority: HIGHEST for action port [ 709.547137] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a5a9b9e-1f82-415e-a875-f7df5e59ecf5 with Priority: HIGHEST for action port [ 709.547275] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a5a9b9e-1f82-415e-a875-f7df5e59ecf5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.547389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a5a9b9e-1f82-415e-a875-f7df5e59ecf5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.547552] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a5a9b9e-1f82-415e-a875-f7df5e59ecf5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.548613] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a5a9b9e-1f82-415e-a875-f7df5e59ecf5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.548613] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a5a9b9e-1f82-415e-a875-f7df5e59ecf5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.548871] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e99a11c8-f108-4784-aa19-9139eb46ce97',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.549527] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ae7ca477-594c-47ae-a235-e80874d36402 with status ACTIVE [ 709.549759] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.549909] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.549981] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.550181] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.550273] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.550440] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.550533] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.550595] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.550735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.550833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.551014] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.551262] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.551328] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.551485] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.551572] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.551656] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ae7ca477-594c-47ae-a235-e80874d36402 is going to be updated. [ 709.572742] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.572742] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.572742] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.572742] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.572742] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.572742] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae7ca477-594c-47ae-a235-e80874d36402" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.055401] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e99a11c8-f108-4784-aa19-9139eb46ce97',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.057473] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a5a9b9e-1f82-415e-a875-f7df5e59ecf5 [ 710.057473] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.057473] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.057473] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.057473] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.057473] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.057473] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a5a9b9e-1f82-415e-a875-f7df5e59ecf5 already deleted. [ 710.057473] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a5a9b9e-1f82-415e-a875-f7df5e59ecf5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.559563] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.559563] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.559563] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.559745] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.559773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.560239] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e99a11c8-f108-4784-aa19-9139eb46ce97 is going to be created. [ 710.587668] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.587803] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.587870] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.588220] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.588351] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.598426] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e99a11c8-f108-4784-aa19-9139eb46ce97 in Status: UNINITIALIZED for 2s [ 711.575746] env[70013]: INFO networking_nsxv3.common.synchronization [req-c34b3dc4-5d9c-472f-81d8-c78dc96265ba req-d57ea162-bac5-48c6-87d2-7c04ac80ac0f tempest-ImagesNegativeTestJSON-2089407727 tempest-ImagesNegativeTestJSON-2089407727-project-member] Enqueued Resource ID: f9170b5f-e125-459e-b403-6aa7ab9296db with Priority: HIGHEST for action security_group_members [ 711.576324] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9170b5f-e125-459e-b403-6aa7ab9296db with Priority: HIGHEST for action security_group_members [ 711.577617] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9170b5f-e125-459e-b403-6aa7ab9296db taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.577617] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.577617] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.577617] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.577617] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.577617] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.578285] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.578285] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.578285] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.578285] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9170b5f-e125-459e-b403-6aa7ab9296db',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.939613] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-602 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.939888] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-602" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.940147] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-602" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.940600] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-602" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.941040] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.941647] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.941647] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.941777] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.941933] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.942365] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 711.942488] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 711.942646] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 711.942797] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 711.942955] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 711.943124] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 711.943314] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 711.962713] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 711.965773] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 711.965773] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 711.965773] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-602" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.965773] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-9c1b9c25-fd2c-4379-959d-d103fa9a5848 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.965773] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-9c1b9c25-fd2c-4379-959d-d103fa9a5848" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.965773] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-9c1b9c25-fd2c-4379-959d-d103fa9a5848" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.965773] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-9c1b9c25-fd2c-4379-959d-d103fa9a5848" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.965773] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c1b9c25-fd2c-4379-959d-d103fa9a5848',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.080492] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.080687] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.080756] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.081067] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.081189] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.081390] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.081508] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.081676] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.081981] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.081981] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.081981] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9170b5f-e125-459e-b403-6aa7ab9296db already deleted. [ 712.082190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.467430] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.467750] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.467872] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.468163] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.468316] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.468469] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 9c1b9c25-fd2c-4379-959d-d103fa9a5848 not found, creating... [ 712.468835] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.469026] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.469147] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.469365] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.469670] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.469794] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.469945] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.470144] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.470371] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.470504] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.470643] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 9c1b9c25-fd2c-4379-959d-d103fa9a5848 is going to be created. [ 712.492340] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.492340] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.492340] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.492340] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.492340] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.492340] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-9c1b9c25-fd2c-4379-959d-d103fa9a5848" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.615994] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e99a11c8-f108-4784-aa19-9139eb46ce97 in Status: SUCCESS [ 712.616273] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e99a11c8-f108-4784-aa19-9139eb46ce97" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.616557] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e99a11c8-f108-4784-aa19-9139eb46ce97" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.616620] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e99a11c8-f108-4784-aa19-9139eb46ce97" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.616795] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.616916] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.616978] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.617182] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.617298] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.618033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e99a11c8-f108-4784-aa19-9139eb46ce97" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.618033] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e99a11c8-f108-4784-aa19-9139eb46ce97',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.120088] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-e99a11c8-f108-4784-aa19-9139eb46ce97 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.122124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e99a11c8-f108-4784-aa19-9139eb46ce97" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.122240] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e99a11c8-f108-4784-aa19-9139eb46ce97" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.122443] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e99a11c8-f108-4784-aa19-9139eb46ce97" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.122627] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.122731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.122798] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.122979] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.123085] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.123203] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e99a11c8-f108-4784-aa19-9139eb46ce97" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.123363] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-e99a11c8-f108-4784-aa19-9139eb46ce97 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.123474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e99a11c8-f108-4784-aa19-9139eb46ce97" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.123576] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e99a11c8-f108-4784-aa19-9139eb46ce97" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.123673] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e99a11c8-f108-4784-aa19-9139eb46ce97" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.123805] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.123893] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.123954] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.124100] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.124176] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.124255] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e99a11c8-f108-4784-aa19-9139eb46ce97" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.124344] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e99a11c8-f108-4784-aa19-9139eb46ce97',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.373863] env[70013]: INFO networking_nsxv3.common.synchronization [req-c34b3dc4-5d9c-472f-81d8-c78dc96265ba req-eb1c123f-4dd2-4771-ba71-b3580eecfeeb service nova] Enqueued Resource ID: f9170b5f-e125-459e-b403-6aa7ab9296db with Priority: HIGHEST for action security_group_rules [ 713.374049] env[70013]: INFO networking_nsxv3.common.synchronization [req-c34b3dc4-5d9c-472f-81d8-c78dc96265ba req-eb1c123f-4dd2-4771-ba71-b3580eecfeeb service nova] Enqueued Resource ID: f9170b5f-e125-459e-b403-6aa7ab9296db with Priority: HIGHEST for action security_group_members [ 713.374180] env[70013]: INFO networking_nsxv3.common.synchronization [req-c34b3dc4-5d9c-472f-81d8-c78dc96265ba req-eb1c123f-4dd2-4771-ba71-b3580eecfeeb service nova] Enqueued Resource ID: 9c1b9c25-fd2c-4379-959d-d103fa9a5848 with Priority: HIGHEST for action port [ 713.374446] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9170b5f-e125-459e-b403-6aa7ab9296db with Priority: HIGHEST for action security_group_rules [ 713.374576] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9170b5f-e125-459e-b403-6aa7ab9296db with Priority: HIGHEST for action security_group_members [ 713.378425] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c1b9c25-fd2c-4379-959d-d103fa9a5848 with Priority: HIGHEST for action port [ 713.378425] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9170b5f-e125-459e-b403-6aa7ab9296db taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.378425] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.378425] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.378425] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.378425] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9170b5f-e125-459e-b403-6aa7ab9296db',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.378425] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9170b5f-e125-459e-b403-6aa7ab9296db taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.378425] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.378425] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.378425] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.378425] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.378425] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.378425] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.378425] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.378425] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.378425] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9170b5f-e125-459e-b403-6aa7ab9296db',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.379124] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c1b9c25-fd2c-4379-959d-d103fa9a5848 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.379124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c1b9c25-fd2c-4379-959d-d103fa9a5848" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.379124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c1b9c25-fd2c-4379-959d-d103fa9a5848" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.379124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c1b9c25-fd2c-4379-959d-d103fa9a5848" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.379124] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c1b9c25-fd2c-4379-959d-d103fa9a5848',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.626861] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e99a11c8-f108-4784-aa19-9139eb46ce97: rpc.has_security_group_logging(os_id): False [ 713.646927] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.647079] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.647148] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.647357] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.647444] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.647688] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.647796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.649382] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.650075] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.650408] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.650878] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.650878] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.650878] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.650878] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.651035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.651160] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.651284] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.651284] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.651954] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.652080] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.652202] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e99a11c8-f108-4784-aa19-9139eb46ce97 is going to be created. [ 713.708830] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.708830] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.708830] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.708830] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.709360] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.721023] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e99a11c8-f108-4784-aa19-9139eb46ce97 in Status: IN_PROGRESS for 2s [ 713.880527] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9170b5f-e125-459e-b403-6aa7ab9296db taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.880887] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.883267] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9170b5f-e125-459e-b403-6aa7ab9296db',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.884506] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c1b9c25-fd2c-4379-959d-d103fa9a5848 with status ACTIVE [ 713.884790] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.884971] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.885101] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.885411] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.885568] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.885853] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.887014] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.887340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.887926] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.888134] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.888475] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.888920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.889099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.889418] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.889612] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.890084] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c1b9c25-fd2c-4379-959d-d103fa9a5848 is going to be updated. [ 713.913045] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.913552] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.913638] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.913871] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.914027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.914190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c1b9c25-fd2c-4379-959d-d103fa9a5848" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.954365] env[70013]: INFO networking_nsxv3.common.synchronization [None req-67b4ba82-f8fe-4637-b24c-1d8e67fbddfd None None] Enqueued Resource ID: 92205bf0-3bc7-4f62-8f0f-fa9ba989cc67 with Priority: HIGHEST for action port [ 713.954365] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92205bf0-3bc7-4f62-8f0f-fa9ba989cc67 with Priority: HIGHEST for action port [ 713.954365] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-92205bf0-3bc7-4f62-8f0f-fa9ba989cc67 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.954365] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92205bf0-3bc7-4f62-8f0f-fa9ba989cc67" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.954365] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92205bf0-3bc7-4f62-8f0f-fa9ba989cc67" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.954562] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92205bf0-3bc7-4f62-8f0f-fa9ba989cc67" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.954633] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92205bf0-3bc7-4f62-8f0f-fa9ba989cc67',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.393442] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9170b5f-e125-459e-b403-6aa7ab9296db',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.457809] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92205bf0-3bc7-4f62-8f0f-fa9ba989cc67 [ 714.458469] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.458469] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.458469] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.458633] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.458633] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.459063] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92205bf0-3bc7-4f62-8f0f-fa9ba989cc67 already deleted. [ 714.459063] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92205bf0-3bc7-4f62-8f0f-fa9ba989cc67" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.899382] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.899695] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.899811] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.899948] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.900089] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.900362] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9170b5f-e125-459e-b403-6aa7ab9296db is going to be created. [ 714.922247] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.922247] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.922247] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.922247] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.922247] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.929995] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9170b5f-e125-459e-b403-6aa7ab9296db in Status: UNINITIALIZED for 2s [ 715.732125] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e99a11c8-f108-4784-aa19-9139eb46ce97 in Status: SUCCESS [ 715.732837] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e99a11c8-f108-4784-aa19-9139eb46ce97" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.445761] env[70013]: INFO networking_nsxv3.common.synchronization [None req-f49e87f1-11c7-4f8f-a45b-afef8b70fde2 None None] Enqueued Resource ID: e7dd65a6-8ab1-4eaa-91d6-4335fec2776a with Priority: HIGHEST for action port [ 716.446046] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7dd65a6-8ab1-4eaa-91d6-4335fec2776a with Priority: HIGHEST for action port [ 716.446617] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7dd65a6-8ab1-4eaa-91d6-4335fec2776a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.446740] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7dd65a6-8ab1-4eaa-91d6-4335fec2776a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.446808] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7dd65a6-8ab1-4eaa-91d6-4335fec2776a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.449765] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7dd65a6-8ab1-4eaa-91d6-4335fec2776a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.449765] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7dd65a6-8ab1-4eaa-91d6-4335fec2776a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.924783] env[70013]: INFO networking_nsxv3.common.synchronization [req-4bc43ce2-a952-4899-b5f7-f8a1a59ea442 req-08e7a932-bbd6-42ee-b1e1-e12cdb098206 tempest-ServersTestBootFromVolume-2114082365 tempest-ServersTestBootFromVolume-2114082365-project-member] Enqueued Resource ID: 9327e489-f357-4ab4-ad7d-eea2d96da52c with Priority: HIGHEST for action security_group_members [ 716.924783] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9327e489-f357-4ab4-ad7d-eea2d96da52c with Priority: HIGHEST for action security_group_members [ 716.924783] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9327e489-f357-4ab4-ad7d-eea2d96da52c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.924783] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.925238] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.925572] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.925817] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.926076] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.926233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.926463] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.926710] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.926877] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9327e489-f357-4ab4-ad7d-eea2d96da52c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.940242] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9170b5f-e125-459e-b403-6aa7ab9296db in Status: SUCCESS [ 716.940242] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.940242] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.940242] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.940863] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.940863] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.940863] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.940863] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.940863] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.940863] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.941405] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9170b5f-e125-459e-b403-6aa7ab9296db',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.954962] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7dd65a6-8ab1-4eaa-91d6-4335fec2776a [ 716.955200] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.955528] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.955528] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.955792] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.955792] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.956011] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7dd65a6-8ab1-4eaa-91d6-4335fec2776a already deleted. [ 716.956099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7dd65a6-8ab1-4eaa-91d6-4335fec2776a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.431682] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.431879] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.432016] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.432371] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.432371] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.432594] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.432743] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.432840] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.433101] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.433369] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.433369] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9327e489-f357-4ab4-ad7d-eea2d96da52c already deleted. [ 717.433466] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.443367] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9170b5f-e125-459e-b403-6aa7ab9296db taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.443576] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.443689] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.444332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.444594] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.445096] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.445280] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.445561] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.446053] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.446270] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.446599] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9170b5f-e125-459e-b403-6aa7ab9296db taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.446761] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.446867] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.448009] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.448009] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.448009] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.448009] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.448009] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.448009] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.448009] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.448009] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9170b5f-e125-459e-b403-6aa7ab9296db',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.451265] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-127 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.451410] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-127" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.452130] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-127" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.452130] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-127" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.452315] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.452559] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.452786] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.453235] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.453235] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.453545] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 717.453730] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 717.453928] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 717.454227] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 717.454415] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 717.454732] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 717.454957] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 717.474621] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 717.474707] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 717.474818] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 717.474992] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-127" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.475328] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-2944f964-96c9-42c8-8914-3737e1a4349a taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.477796] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-2944f964-96c9-42c8-8914-3737e1a4349a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.477796] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-2944f964-96c9-42c8-8914-3737e1a4349a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.477796] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-2944f964-96c9-42c8-8914-3737e1a4349a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.477796] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2944f964-96c9-42c8-8914-3737e1a4349a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.959752] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9170b5f-e125-459e-b403-6aa7ab9296db: rpc.has_security_group_logging(os_id): False [ 717.982026] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.982026] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.982026] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.982026] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.982026] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.982026] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.982372] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.982372] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.982429] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.982486] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.982751] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.982897] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.982998] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.983238] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.983323] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.983552] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.983659] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.983720] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.983905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.983982] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.984116] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9170b5f-e125-459e-b403-6aa7ab9296db is going to be created. [ 717.985647] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.985842] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.986015] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.986274] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.986433] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.986589] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 2944f964-96c9-42c8-8914-3737e1a4349a not found, creating... [ 717.986889] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.987096] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.987214] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.987499] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.987655] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.988033] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.988242] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.988391] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.988631] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.988854] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.989078] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 2944f964-96c9-42c8-8914-3737e1a4349a is going to be created. [ 718.021566] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.021566] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.021676] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.021892] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.022142] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.022372] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-2944f964-96c9-42c8-8914-3737e1a4349a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.060137] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.060137] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.060137] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.060137] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.060137] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.088279] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9170b5f-e125-459e-b403-6aa7ab9296db in Status: IN_PROGRESS for 2s [ 718.809891] env[70013]: INFO networking_nsxv3.common.synchronization [None req-b40f31a6-1056-4558-8515-0bde8a604cbf None None] Enqueued Resource ID: d941df72-6b3f-4301-88f1-450616888f45 with Priority: HIGHEST for action port [ 718.810212] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d941df72-6b3f-4301-88f1-450616888f45 with Priority: HIGHEST for action port [ 718.810621] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-d941df72-6b3f-4301-88f1-450616888f45 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.810752] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d941df72-6b3f-4301-88f1-450616888f45" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.810811] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d941df72-6b3f-4301-88f1-450616888f45" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.811137] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d941df72-6b3f-4301-88f1-450616888f45" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.811230] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d941df72-6b3f-4301-88f1-450616888f45',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.879482] env[70013]: INFO networking_nsxv3.common.synchronization [req-4bc43ce2-a952-4899-b5f7-f8a1a59ea442 req-6971da9c-14e0-4a7b-bb61-f1a5009fda45 service nova] Enqueued Resource ID: 9327e489-f357-4ab4-ad7d-eea2d96da52c with Priority: HIGHEST for action security_group_rules [ 718.879657] env[70013]: INFO networking_nsxv3.common.synchronization [req-4bc43ce2-a952-4899-b5f7-f8a1a59ea442 req-6971da9c-14e0-4a7b-bb61-f1a5009fda45 service nova] Enqueued Resource ID: 9327e489-f357-4ab4-ad7d-eea2d96da52c with Priority: HIGHEST for action security_group_members [ 718.879792] env[70013]: INFO networking_nsxv3.common.synchronization [req-4bc43ce2-a952-4899-b5f7-f8a1a59ea442 req-6971da9c-14e0-4a7b-bb61-f1a5009fda45 service nova] Enqueued Resource ID: 2944f964-96c9-42c8-8914-3737e1a4349a with Priority: HIGHEST for action port [ 718.880032] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9327e489-f357-4ab4-ad7d-eea2d96da52c with Priority: HIGHEST for action security_group_rules [ 718.880158] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9327e489-f357-4ab4-ad7d-eea2d96da52c with Priority: HIGHEST for action security_group_members [ 718.880255] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2944f964-96c9-42c8-8914-3737e1a4349a with Priority: HIGHEST for action port [ 718.880768] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9327e489-f357-4ab4-ad7d-eea2d96da52c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.880939] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.881026] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.881228] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.881310] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9327e489-f357-4ab4-ad7d-eea2d96da52c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.885019] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9327e489-f357-4ab4-ad7d-eea2d96da52c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.885019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.885019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.885019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.885019] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.885019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.885019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.885019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.885019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.885019] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9327e489-f357-4ab4-ad7d-eea2d96da52c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.885019] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-2944f964-96c9-42c8-8914-3737e1a4349a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.885019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2944f964-96c9-42c8-8914-3737e1a4349a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.885019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2944f964-96c9-42c8-8914-3737e1a4349a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.887388] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2944f964-96c9-42c8-8914-3737e1a4349a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.887487] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2944f964-96c9-42c8-8914-3737e1a4349a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.313839] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d941df72-6b3f-4301-88f1-450616888f45 [ 719.314108] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.314299] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.314995] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.314995] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.314995] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.314995] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d941df72-6b3f-4301-88f1-450616888f45 already deleted. [ 719.314995] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d941df72-6b3f-4301-88f1-450616888f45" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.392032] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9327e489-f357-4ab4-ad7d-eea2d96da52c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.392032] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9327e489-f357-4ab4-ad7d-eea2d96da52c taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.392032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.392032] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2944f964-96c9-42c8-8914-3737e1a4349a with status ACTIVE [ 719.392032] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.392032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.392032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.392032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.392032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.392032] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.392032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.392032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.392032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.392870] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.393250] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.395525] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.395525] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.395525] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.395525] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.395525] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2944f964-96c9-42c8-8914-3737e1a4349a is going to be updated. [ 719.413107] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.413257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.413322] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.413530] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.413689] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.415486] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2944f964-96c9-42c8-8914-3737e1a4349a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.896615] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9327e489-f357-4ab4-ad7d-eea2d96da52c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.101812] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9170b5f-e125-459e-b403-6aa7ab9296db in Status: SUCCESS [ 720.102091] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.400218] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.400412] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.400412] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.400611] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.400737] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.400845] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9327e489-f357-4ab4-ad7d-eea2d96da52c is going to be created. [ 720.430868] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.431096] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.431169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.431390] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.431552] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.443556] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9327e489-f357-4ab4-ad7d-eea2d96da52c in Status: UNINITIALIZED for 2s [ 721.053424] env[70013]: INFO networking_nsxv3.common.synchronization [None req-a804ba03-b4da-474b-845d-321435817a05 None None] Enqueued Resource ID: 3c7fb240-c0c1-4d92-bc9f-1ab09139a42b with Priority: HIGHEST for action port [ 721.053723] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c7fb240-c0c1-4d92-bc9f-1ab09139a42b with Priority: HIGHEST for action port [ 721.054233] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c7fb240-c0c1-4d92-bc9f-1ab09139a42b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.054381] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c7fb240-c0c1-4d92-bc9f-1ab09139a42b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.054470] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c7fb240-c0c1-4d92-bc9f-1ab09139a42b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.054730] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c7fb240-c0c1-4d92-bc9f-1ab09139a42b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.054820] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c7fb240-c0c1-4d92-bc9f-1ab09139a42b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.557676] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c7fb240-c0c1-4d92-bc9f-1ab09139a42b [ 721.558024] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.558181] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.558250] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.558459] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.558585] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.558716] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c7fb240-c0c1-4d92-bc9f-1ab09139a42b already deleted. [ 721.558823] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c7fb240-c0c1-4d92-bc9f-1ab09139a42b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.655574] env[70013]: INFO networking_nsxv3.common.synchronization [req-55f57f7e-f086-4985-9b92-120bb80b0762 req-05b7b7a3-3ee7-4e08-bd0e-3c066e297dc9 tempest-ServersTestJSON-1543902807 tempest-ServersTestJSON-1543902807-project-member] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 721.656228] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 721.656579] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.656889] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.656889] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.659019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.659235] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.659617] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.659617] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.659617] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.659762] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.659875] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.013923] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-250 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.014137] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-250" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.014259] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-250" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.014575] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-250" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.014832] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.014985] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.015124] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.015337] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.015478] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.015681] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 722.015790] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 722.015895] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 722.015999] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 722.016128] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 722.016253] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 722.016413] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 722.033618] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 722.033780] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 722.033913] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 722.034096] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-250" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.034398] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-347b7e73-55ed-4f2b-96f7-96ab25367148 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.034558] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-347b7e73-55ed-4f2b-96f7-96ab25367148" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.034673] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-347b7e73-55ed-4f2b-96f7-96ab25367148" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.034971] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-347b7e73-55ed-4f2b-96f7-96ab25367148" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.035145] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('347b7e73-55ed-4f2b-96f7-96ab25367148',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.163318] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.163590] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.163590] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.163728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.163854] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.164228] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.164415] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.164415] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.164578] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.164674] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.164773] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a already deleted. [ 722.165025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.454066] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9327e489-f357-4ab4-ad7d-eea2d96da52c in Status: SUCCESS [ 722.454434] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.454682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.455402] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.455402] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.455402] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.455641] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.455748] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.455925] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.456067] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.456189] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9327e489-f357-4ab4-ad7d-eea2d96da52c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.537437] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.537698] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.537855] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.538160] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.538338] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.538538] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 347b7e73-55ed-4f2b-96f7-96ab25367148 not found, creating... [ 722.538866] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.539097] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.539221] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.539458] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.539686] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.540132] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.540354] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.540582] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.540890] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.541137] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.541357] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 347b7e73-55ed-4f2b-96f7-96ab25367148 is going to be created. [ 722.561326] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.561608] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.561782] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.562146] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.562393] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.562631] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-347b7e73-55ed-4f2b-96f7-96ab25367148" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.958252] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9327e489-f357-4ab4-ad7d-eea2d96da52c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.300968] env[70013]: INFO networking_nsxv3.common.synchronization [req-55f57f7e-f086-4985-9b92-120bb80b0762 req-aca71275-0c89-422f-abbf-f246e26e5840 service nova] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_rules [ 723.301291] env[70013]: INFO networking_nsxv3.common.synchronization [req-55f57f7e-f086-4985-9b92-120bb80b0762 req-aca71275-0c89-422f-abbf-f246e26e5840 service nova] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 723.301372] env[70013]: INFO networking_nsxv3.common.synchronization [req-55f57f7e-f086-4985-9b92-120bb80b0762 req-aca71275-0c89-422f-abbf-f246e26e5840 service nova] Enqueued Resource ID: 347b7e73-55ed-4f2b-96f7-96ab25367148 with Priority: HIGHEST for action port [ 723.303569] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_rules [ 723.303569] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 723.303569] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 347b7e73-55ed-4f2b-96f7-96ab25367148 with Priority: HIGHEST for action port [ 723.303569] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.303569] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.303569] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.303569] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.303569] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.304836] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.304836] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.304989] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.305661] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.305661] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.305661] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.305661] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.305661] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.305661] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.305900] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.306776] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-347b7e73-55ed-4f2b-96f7-96ab25367148 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.306876] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-347b7e73-55ed-4f2b-96f7-96ab25367148" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.306933] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-347b7e73-55ed-4f2b-96f7-96ab25367148" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.309967] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-347b7e73-55ed-4f2b-96f7-96ab25367148" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.309967] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('347b7e73-55ed-4f2b-96f7-96ab25367148',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.460811] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9327e489-f357-4ab4-ad7d-eea2d96da52c: rpc.has_security_group_logging(os_id): False [ 723.480841] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.481037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.481140] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.481394] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.481522] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.482317] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.482317] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.482317] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.482317] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.482317] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.482317] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9327e489-f357-4ab4-ad7d-eea2d96da52c is going to be created. [ 723.539768] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.539932] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.540066] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.540237] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.544090] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.550831] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9327e489-f357-4ab4-ad7d-eea2d96da52c in Status: IN_PROGRESS for 2s [ 723.758514] env[70013]: INFO networking_nsxv3.common.synchronization [req-5b28f93a-4499-4f5d-b2bc-316d52b56450 req-adaf34e6-59e3-4f4d-ab0f-5428c818576b tempest-ImagesNegativeTestJSON-2089407727 tempest-ImagesNegativeTestJSON-2089407727-project-member] Enqueued Resource ID: f9170b5f-e125-459e-b403-6aa7ab9296db with Priority: HIGHEST for action security_group_members [ 723.759785] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9170b5f-e125-459e-b403-6aa7ab9296db with Priority: HIGHEST for action security_group_members [ 723.759785] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9170b5f-e125-459e-b403-6aa7ab9296db taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.759785] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.759785] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.760098] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.760098] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.760223] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.760223] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.760326] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.760416] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.760514] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9170b5f-e125-459e-b403-6aa7ab9296db',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.812246] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.814096] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.814437] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.814727] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 347b7e73-55ed-4f2b-96f7-96ab25367148 with status ACTIVE [ 723.815105] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.815382] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.816027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.816027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.816027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.816281] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.816497] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.816648] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.817864] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.817864] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.817864] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.817864] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.817864] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.820401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.820401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.820401] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 347b7e73-55ed-4f2b-96f7-96ab25367148 is going to be updated. [ 723.840273] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.841679] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.841679] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.841679] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.841679] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.841679] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-347b7e73-55ed-4f2b-96f7-96ab25367148" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.234022] env[70013]: INFO networking_nsxv3.common.synchronization [req-c79be9a9-932f-4bf4-8968-96d29d04a08f req-cb948a6e-7da5-4005-a6dd-6433d402e459 tempest-AttachInterfacesV270Test-1942387806 tempest-AttachInterfacesV270Test-1942387806-project-member] Enqueued Resource ID: e99a11c8-f108-4784-aa19-9139eb46ce97 with Priority: HIGHEST for action security_group_members [ 724.234524] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e99a11c8-f108-4784-aa19-9139eb46ce97 with Priority: HIGHEST for action security_group_members [ 724.235179] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-e99a11c8-f108-4784-aa19-9139eb46ce97 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.235179] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e99a11c8-f108-4784-aa19-9139eb46ce97" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.235179] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e99a11c8-f108-4784-aa19-9139eb46ce97" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.235449] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e99a11c8-f108-4784-aa19-9139eb46ce97" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.235670] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.235819] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.235915] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.236179] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.236364] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.236557] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e99a11c8-f108-4784-aa19-9139eb46ce97',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.262758] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.263918] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.263918] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.264205] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.264328] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.264554] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.264664] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.264730] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.264890] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.264970] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.265076] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9170b5f-e125-459e-b403-6aa7ab9296db is going to be updated. [ 724.292122] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.292399] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.292513] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.292785] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.292990] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.301719] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9170b5f-e125-459e-b403-6aa7ab9296db in Status: IN_PROGRESS for 2s [ 724.320593] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.739397] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.739581] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.739703] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.740629] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.740629] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.740629] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.740629] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.740629] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.740629] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.740629] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.740629] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e99a11c8-f108-4784-aa19-9139eb46ce97 is going to be updated. [ 724.768766] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.769011] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.769139] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.769459] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.769671] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.778874] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e99a11c8-f108-4784-aa19-9139eb46ce97 in Status: IN_PROGRESS for 2s [ 724.824375] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.824375] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.824375] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.824375] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.824375] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.825839] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a is going to be created. [ 724.851152] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.851152] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.851152] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.851152] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.851152] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.861970] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: UNINITIALIZED for 2s [ 725.565831] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9327e489-f357-4ab4-ad7d-eea2d96da52c in Status: SUCCESS [ 725.566137] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.311772] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9170b5f-e125-459e-b403-6aa7ab9296db in Status: SUCCESS [ 726.312111] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9170b5f-e125-459e-b403-6aa7ab9296db deletion is rescheduled due to dependency. [ 726.312246] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.788681] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e99a11c8-f108-4784-aa19-9139eb46ce97 in Status: SUCCESS [ 726.788681] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e99a11c8-f108-4784-aa19-9139eb46ce97 deletion is rescheduled due to dependency. [ 726.788681] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e99a11c8-f108-4784-aa19-9139eb46ce97" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.872021] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: SUCCESS [ 726.872021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.872021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.872021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.872021] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.872021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.872021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.872021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.872021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.872021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.872021] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.375591] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.375835] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.375835] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.376361] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.376896] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.376896] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.377118] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.377118] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.377220] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.377341] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.377488] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.377553] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.377600] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.377713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.377830] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.377915] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.378061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.378154] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.378229] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.378305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.378392] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.881837] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f422a68f-f64a-4d93-9deb-289ae02aea3a: rpc.has_security_group_logging(os_id): False [ 727.916224] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.916375] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.916447] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.916659] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.916842] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.916966] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.917081] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.917123] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.917265] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.917365] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.917507] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.917597] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.917653] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.917821] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.917869] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.918030] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.918130] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.918190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.918347] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.918421] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.918505] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a is going to be created. [ 727.979938] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.979938] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.979938] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.979938] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.980171] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.003363] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: IN_PROGRESS for 2s [ 728.251019] env[70013]: INFO networking_nsxv3.common.synchronization [req-e08742d2-c836-433f-ad73-bfdb58dc2dae req-95ed5c34-71fe-4953-8af3-51602f639ffd tempest-ImagesTestJSON-851757871 tempest-ImagesTestJSON-851757871-project-member] Enqueued Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 728.251019] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 728.251019] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.251019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.251019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.251019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.251019] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.251019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.251019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.251019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.251019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.251019] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.753678] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.753903] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.754045] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.754338] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.754451] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.754734] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.754910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.755716] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.755716] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.755716] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.755716] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 is going to be updated. [ 728.785271] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.785271] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.785271] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.785271] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.785271] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.795473] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: IN_PROGRESS for 2s [ 730.014324] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: SUCCESS [ 730.014589] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.519454] env[70013]: INFO networking_nsxv3.common.synchronization [req-6833ed38-80d2-49ae-9f06-52612927c4a9 req-54dcaeb4-080d-4597-ab5e-719d72d8c7c1 tempest-FloatingIPsAssociationTestJSON-1070439366 tempest-FloatingIPsAssociationTestJSON-1070439366-project-member] Enqueued Resource ID: ff280f19-627b-45ca-afac-7d9154581e89 with Priority: HIGHEST for action security_group_members [ 730.520031] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff280f19-627b-45ca-afac-7d9154581e89 with Priority: HIGHEST for action security_group_members [ 730.520290] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff280f19-627b-45ca-afac-7d9154581e89 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.520414] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.520483] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.520704] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.521331] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.521331] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.521331] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.521331] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.521331] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.521537] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff280f19-627b-45ca-afac-7d9154581e89',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.807353] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: SUCCESS [ 730.807517] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 deletion is rescheduled due to dependency. [ 730.808337] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.030510] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.030804] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.030804] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.030949] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.031517] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.031517] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.031517] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.031517] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.031692] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.031692] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.031757] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff280f19-627b-45ca-afac-7d9154581e89 is going to be updated. [ 731.057111] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.057256] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.057306] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.057484] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.057621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.064906] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff280f19-627b-45ca-afac-7d9154581e89 in Status: IN_PROGRESS for 2s [ 731.582677] env[70013]: INFO networking_nsxv3.common.synchronization [req-bd1e2fe6-5dac-4ca3-8ca7-367c2b131aaa req-29273963-09cd-4b54-a813-2766b0319c42 tempest-ServersAdminNegativeTestJSON-1634392682 tempest-ServersAdminNegativeTestJSON-1634392682-project-member] Enqueued Resource ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 with Priority: HIGHEST for action security_group_members [ 731.583396] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 with Priority: HIGHEST for action security_group_members [ 731.584051] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.584331] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.584485] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.584828] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.585100] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.586631] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.586631] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.586631] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.586631] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.586631] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cff04b9a-dfb1-4bca-9a12-21566cf5fe37',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.090143] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.090143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.090143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.090143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.090143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.090143] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.090143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.090143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.090143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.090863] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.090863] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 already deleted. [ 732.091434] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.119428] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-701 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.119612] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.119730] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.120347] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.120347] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.120503] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.120503] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.120714] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.120855] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.121095] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 732.121220] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 732.121393] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 732.121465] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 732.121567] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 732.121681] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 732.121888] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 732.140451] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 732.140616] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 732.140752] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 732.140925] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.141280] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-acad913d-4d60-4211-8b2f-e30f6f1d525c taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.141449] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-acad913d-4d60-4211-8b2f-e30f6f1d525c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.141565] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-acad913d-4d60-4211-8b2f-e30f6f1d525c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.141874] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-acad913d-4d60-4211-8b2f-e30f6f1d525c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.142029] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acad913d-4d60-4211-8b2f-e30f6f1d525c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.645065] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.645307] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.645525] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.645706] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.645889] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.646061] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port acad913d-4d60-4211-8b2f-e30f6f1d525c not found, creating... [ 732.646354] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.646498] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.646635] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.646861] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.647007] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.647312] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.647468] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.647583] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.647788] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.647920] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.648090] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: acad913d-4d60-4211-8b2f-e30f6f1d525c is going to be created. [ 732.668549] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.668549] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.668653] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.668891] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.669247] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.669385] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-acad913d-4d60-4211-8b2f-e30f6f1d525c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.074631] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff280f19-627b-45ca-afac-7d9154581e89 in Status: SUCCESS [ 733.074798] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff280f19-627b-45ca-afac-7d9154581e89 deletion is rescheduled due to dependency. [ 733.074915] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.366771] env[70013]: INFO networking_nsxv3.common.synchronization [req-bd1e2fe6-5dac-4ca3-8ca7-367c2b131aaa req-21cb091a-220b-46db-a93c-040531976c5b service nova] Enqueued Resource ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 with Priority: HIGHEST for action security_group_rules [ 733.366771] env[70013]: INFO networking_nsxv3.common.synchronization [req-bd1e2fe6-5dac-4ca3-8ca7-367c2b131aaa req-21cb091a-220b-46db-a93c-040531976c5b service nova] Enqueued Resource ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 with Priority: HIGHEST for action security_group_members [ 733.366771] env[70013]: INFO networking_nsxv3.common.synchronization [req-bd1e2fe6-5dac-4ca3-8ca7-367c2b131aaa req-21cb091a-220b-46db-a93c-040531976c5b service nova] Enqueued Resource ID: acad913d-4d60-4211-8b2f-e30f6f1d525c with Priority: HIGHEST for action port [ 733.373440] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 with Priority: HIGHEST for action security_group_rules [ 733.373440] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 with Priority: HIGHEST for action security_group_members [ 733.373440] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acad913d-4d60-4211-8b2f-e30f6f1d525c with Priority: HIGHEST for action port [ 733.373440] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cff04b9a-dfb1-4bca-9a12-21566cf5fe37 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.373440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.373440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.373440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.373440] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cff04b9a-dfb1-4bca-9a12-21566cf5fe37',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.373440] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.373440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.373440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.373440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.373440] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.373440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.373440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.373440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.373440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.373440] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cff04b9a-dfb1-4bca-9a12-21566cf5fe37',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.375083] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-acad913d-4d60-4211-8b2f-e30f6f1d525c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.375083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acad913d-4d60-4211-8b2f-e30f6f1d525c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.375083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acad913d-4d60-4211-8b2f-e30f6f1d525c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.375083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acad913d-4d60-4211-8b2f-e30f6f1d525c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.375083] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acad913d-4d60-4211-8b2f-e30f6f1d525c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.875701] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.875862] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.876151] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cff04b9a-dfb1-4bca-9a12-21566cf5fe37',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.877588] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port acad913d-4d60-4211-8b2f-e30f6f1d525c with status ACTIVE [ 733.877828] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.877941] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.878039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.878287] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.878405] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.878601] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.878762] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.878857] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.879203] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.879434] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.879535] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.879643] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.879742] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.879875] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.879967] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.880233] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: acad913d-4d60-4211-8b2f-e30f6f1d525c is going to be updated. [ 733.904786] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.904786] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.904906] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.905071] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.905209] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.905365] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acad913d-4d60-4211-8b2f-e30f6f1d525c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.383282] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cff04b9a-dfb1-4bca-9a12-21566cf5fe37',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.885369] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.885605] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.885605] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.885754] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.885848] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.885945] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 is going to be created. [ 734.908609] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.908762] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.908830] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.909077] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.909276] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.919071] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 in Status: UNINITIALIZED for 2s [ 736.930081] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 in Status: SUCCESS [ 736.930362] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.930492] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.930728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.930965] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.931177] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.931253] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.931421] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.931506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.931720] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.931720] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cff04b9a-dfb1-4bca-9a12-21566cf5fe37',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.435677] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.435677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.435677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.435677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.435677] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.435677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.435677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.435677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.435677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.435677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.435677] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.435677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.435677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.435677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.435677] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.436354] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.436354] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.436354] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.436354] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.436354] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.436354] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cff04b9a-dfb1-4bca-9a12-21566cf5fe37',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.941294] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cff04b9a-dfb1-4bca-9a12-21566cf5fe37: rpc.has_security_group_logging(os_id): False [ 737.961885] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.962086] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.962178] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.962411] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.962509] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.962705] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.962814] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.962871] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.963025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.963092] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.963289] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.963410] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.963464] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.963898] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.963898] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.964057] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.964104] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.965467] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.965467] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.965467] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.965467] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 is going to be created. [ 738.049941] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.050125] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.050180] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.050470] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.050571] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.063197] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 in Status: IN_PROGRESS for 2s [ 738.370816] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 738.370921] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 738.498381] env[70013]: INFO networking_nsxv3.common.synchronization [None req-1780690d-04cb-4b2e-abd5-30ad104aec47 tempest-ImagesOneServerNegativeTestJSON-165560685 tempest-ImagesOneServerNegativeTestJSON-165560685-project-member] Enqueued Resource ID: 730972c5-b3f5-46de-8f8f-c1ab31a8aa1d with Priority: HIGHEST for action security_group_rules [ 738.498894] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 730972c5-b3f5-46de-8f8f-c1ab31a8aa1d with Priority: HIGHEST for action security_group_rules [ 738.500025] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-730972c5-b3f5-46de-8f8f-c1ab31a8aa1d taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.500025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-730972c5-b3f5-46de-8f8f-c1ab31a8aa1d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.500025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-730972c5-b3f5-46de-8f8f-c1ab31a8aa1d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.500025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-730972c5-b3f5-46de-8f8f-c1ab31a8aa1d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.500025] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('730972c5-b3f5-46de-8f8f-c1ab31a8aa1d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.598467] env[70013]: INFO networking_nsxv3.common.synchronization [None req-47253c96-b99d-4e4e-8285-faebb8a77d68 tempest-ImagesOneServerNegativeTestJSON-165560685 tempest-ImagesOneServerNegativeTestJSON-165560685-project-member] Enqueued Resource ID: 730972c5-b3f5-46de-8f8f-c1ab31a8aa1d with Priority: HIGHEST for action security_group_rules [ 738.598629] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 730972c5-b3f5-46de-8f8f-c1ab31a8aa1d with Priority: HIGHEST for action security_group_rules [ 738.598885] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-730972c5-b3f5-46de-8f8f-c1ab31a8aa1d taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.598982] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-730972c5-b3f5-46de-8f8f-c1ab31a8aa1d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.022786] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.022786] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.022786] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.023809] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.023809] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.023809] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 730972c5-b3f5-46de-8f8f-c1ab31a8aa1d already deleted. [ 739.023809] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-730972c5-b3f5-46de-8f8f-c1ab31a8aa1d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.023809] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-730972c5-b3f5-46de-8f8f-c1ab31a8aa1d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.023809] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-730972c5-b3f5-46de-8f8f-c1ab31a8aa1d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.023809] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('730972c5-b3f5-46de-8f8f-c1ab31a8aa1d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.545726] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.545879] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.545929] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.546666] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.546666] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.546666] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 730972c5-b3f5-46de-8f8f-c1ab31a8aa1d already deleted. [ 739.546666] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-730972c5-b3f5-46de-8f8f-c1ab31a8aa1d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.600117] env[70013]: INFO networking_nsxv3.common.synchronization [req-d46db345-f034-47f0-916e-d803f8844822 req-021945e8-91c0-431f-b410-001efa21251c tempest-ServersWithSpecificFlavorTestJSON-1827464871 tempest-ServersWithSpecificFlavorTestJSON-1827464871-project-member] Enqueued Resource ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 with Priority: HIGHEST for action security_group_members [ 739.600117] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 with Priority: HIGHEST for action security_group_members [ 739.600117] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.600117] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.600117] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.600760] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.601262] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.601883] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.601883] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.603799] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.603799] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.603799] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.075291] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 in Status: SUCCESS [ 740.075530] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.105426] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.105676] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.105676] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.105871] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.105939] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.106138] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.106242] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.106299] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.106447] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.106523] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.106607] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 is going to be updated. [ 740.137142] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.137142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.137142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.137142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.137142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.143264] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 in Status: IN_PROGRESS for 2s [ 742.156466] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 in Status: SUCCESS [ 742.156722] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 deletion is rescheduled due to dependency. [ 742.156722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.335675] env[70013]: INFO networking_nsxv3.common.synchronization [req-7c463a3b-834a-4a74-8c96-1cf05f726c07 req-d70b98aa-03cd-4f65-9490-369b4b366a77 tempest-ServersTestJSON-2095302437 tempest-ServersTestJSON-2095302437-project-member] Enqueued Resource ID: d1b8da2b-4abc-407f-9635-008e18b53627 with Priority: HIGHEST for action security_group_members [ 744.336344] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1b8da2b-4abc-407f-9635-008e18b53627 with Priority: HIGHEST for action security_group_members [ 744.336790] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1b8da2b-4abc-407f-9635-008e18b53627 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.336865] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.336955] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.337593] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.337837] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.337974] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.338073] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.338395] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.338789] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.338915] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1b8da2b-4abc-407f-9635-008e18b53627',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.612249] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-956 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.612249] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-956" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.612249] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-956" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.612249] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-956" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.612249] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.612249] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.616135] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.616135] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.616135] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.616135] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 744.616135] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 744.616422] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 744.619028] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 744.619028] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 744.619028] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 744.619028] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 744.636090] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 744.636288] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 744.636428] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 744.636612] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-956" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.636928] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-271f324e-5244-40df-9393-7b0a123839bb taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.637153] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-271f324e-5244-40df-9393-7b0a123839bb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.637277] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-271f324e-5244-40df-9393-7b0a123839bb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.637689] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-271f324e-5244-40df-9393-7b0a123839bb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.637832] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('271f324e-5244-40df-9393-7b0a123839bb',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.841645] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.841645] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.841645] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.841645] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.841645] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.841918] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.841918] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.841999] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.842141] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.842209] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.842297] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1b8da2b-4abc-407f-9635-008e18b53627 already deleted. [ 744.842378] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.139780] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.140010] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.140152] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.140585] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.140658] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.140801] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 271f324e-5244-40df-9393-7b0a123839bb not found, creating... [ 745.141076] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.141247] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.141371] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.141593] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.141733] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.142019] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.142174] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.142291] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.142494] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.142626] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.142761] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 271f324e-5244-40df-9393-7b0a123839bb is going to be created. [ 745.161995] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.162278] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.162628] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.162695] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.162934] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.163187] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-271f324e-5244-40df-9393-7b0a123839bb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.990878] env[70013]: INFO networking_nsxv3.common.synchronization [req-7c463a3b-834a-4a74-8c96-1cf05f726c07 req-585cbd3e-d157-40f3-a0cb-042cdcfa56a3 service nova] Enqueued Resource ID: d1b8da2b-4abc-407f-9635-008e18b53627 with Priority: HIGHEST for action security_group_rules [ 745.991191] env[70013]: INFO networking_nsxv3.common.synchronization [req-7c463a3b-834a-4a74-8c96-1cf05f726c07 req-585cbd3e-d157-40f3-a0cb-042cdcfa56a3 service nova] Enqueued Resource ID: d1b8da2b-4abc-407f-9635-008e18b53627 with Priority: HIGHEST for action security_group_members [ 745.991191] env[70013]: INFO networking_nsxv3.common.synchronization [req-7c463a3b-834a-4a74-8c96-1cf05f726c07 req-585cbd3e-d157-40f3-a0cb-042cdcfa56a3 service nova] Enqueued Resource ID: 271f324e-5244-40df-9393-7b0a123839bb with Priority: HIGHEST for action port [ 745.991432] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1b8da2b-4abc-407f-9635-008e18b53627 with Priority: HIGHEST for action security_group_rules [ 745.991559] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1b8da2b-4abc-407f-9635-008e18b53627 with Priority: HIGHEST for action security_group_members [ 745.991655] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 271f324e-5244-40df-9393-7b0a123839bb with Priority: HIGHEST for action port [ 745.992224] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1b8da2b-4abc-407f-9635-008e18b53627 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.992351] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.992421] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.992636] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.992754] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1b8da2b-4abc-407f-9635-008e18b53627',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.993590] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1b8da2b-4abc-407f-9635-008e18b53627 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.993704] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.993771] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.993936] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.994105] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.994201] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.994264] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.994404] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.994492] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.994578] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1b8da2b-4abc-407f-9635-008e18b53627',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.995695] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-271f324e-5244-40df-9393-7b0a123839bb taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.995755] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-271f324e-5244-40df-9393-7b0a123839bb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.995806] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-271f324e-5244-40df-9393-7b0a123839bb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.995957] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-271f324e-5244-40df-9393-7b0a123839bb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.996045] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('271f324e-5244-40df-9393-7b0a123839bb',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.501022] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1b8da2b-4abc-407f-9635-008e18b53627 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.501022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.501022] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1b8da2b-4abc-407f-9635-008e18b53627',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.501022] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 271f324e-5244-40df-9393-7b0a123839bb with status ACTIVE [ 746.501022] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.502196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.502196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.502196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.502196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.502196] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.502196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.502196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.502196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.502196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.502196] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.502506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.502506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.502506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.502584] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.502879] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 271f324e-5244-40df-9393-7b0a123839bb is going to be updated. [ 746.522030] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.522030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.522275] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.522341] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.522492] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.522653] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-271f324e-5244-40df-9393-7b0a123839bb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.004270] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1b8da2b-4abc-407f-9635-008e18b53627',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.506344] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.506567] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.506567] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.506767] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.506858] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.506953] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1b8da2b-4abc-407f-9635-008e18b53627 is going to be created. [ 747.529489] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.529673] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.529711] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.529904] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.530083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.538877] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1b8da2b-4abc-407f-9635-008e18b53627 in Status: UNINITIALIZED for 2s [ 749.550038] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1b8da2b-4abc-407f-9635-008e18b53627 in Status: SUCCESS [ 749.550342] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.550469] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.550698] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.550911] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.551048] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.551118] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.551373] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.551462] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.551549] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.551645] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1b8da2b-4abc-407f-9635-008e18b53627',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.054370] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1b8da2b-4abc-407f-9635-008e18b53627',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.561788] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1b8da2b-4abc-407f-9635-008e18b53627: rpc.has_security_group_logging(os_id): False [ 750.580215] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.580356] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.580454] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.580657] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.580767] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.581500] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.581500] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.581500] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.581500] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.581500] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.581500] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1b8da2b-4abc-407f-9635-008e18b53627 is going to be created. [ 750.643320] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.643616] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.643780] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.644153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.644473] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.655789] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1b8da2b-4abc-407f-9635-008e18b53627 in Status: IN_PROGRESS for 2s [ 750.993564] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 750.993564] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 752.098056] env[70013]: INFO networking_nsxv3.common.synchronization [None req-ea8c02f8-e302-4550-add6-844e21592345 None None] Enqueued Resource ID: 41427e10-7646-43dc-98a7-b8c81bd8cbcb with Priority: HIGHEST for action port [ 752.098056] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41427e10-7646-43dc-98a7-b8c81bd8cbcb with Priority: HIGHEST for action port [ 752.098056] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-41427e10-7646-43dc-98a7-b8c81bd8cbcb taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.098056] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41427e10-7646-43dc-98a7-b8c81bd8cbcb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.098056] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41427e10-7646-43dc-98a7-b8c81bd8cbcb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.098056] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41427e10-7646-43dc-98a7-b8c81bd8cbcb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.098056] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41427e10-7646-43dc-98a7-b8c81bd8cbcb',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.601185] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41427e10-7646-43dc-98a7-b8c81bd8cbcb [ 752.601185] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.601185] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.601185] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.601185] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.601185] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.601449] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41427e10-7646-43dc-98a7-b8c81bd8cbcb already deleted. [ 752.601449] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41427e10-7646-43dc-98a7-b8c81bd8cbcb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.670931] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1b8da2b-4abc-407f-9635-008e18b53627 in Status: SUCCESS [ 752.670931] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.543164] env[70013]: INFO networking_nsxv3.common.synchronization [None req-034154b7-90dc-4f82-b47f-5d579c43e3c7 tempest-AttachVolumeNegativeTest-680083968 tempest-AttachVolumeNegativeTest-680083968-project-member] Enqueued Resource ID: f43167c6-5d75-4a22-ac5d-d671524fba53 with Priority: HIGHEST for action security_group_rules [ 753.543559] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f43167c6-5d75-4a22-ac5d-d671524fba53 with Priority: HIGHEST for action security_group_rules [ 753.543852] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f43167c6-5d75-4a22-ac5d-d671524fba53 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.544019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.544073] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.544283] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.544369] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f43167c6-5d75-4a22-ac5d-d671524fba53',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.626656] env[70013]: INFO networking_nsxv3.common.synchronization [None req-4bb68bf7-973b-4afc-8b7c-b1361298ecdd tempest-AttachVolumeNegativeTest-680083968 tempest-AttachVolumeNegativeTest-680083968-project-member] Enqueued Resource ID: f43167c6-5d75-4a22-ac5d-d671524fba53 with Priority: HIGHEST for action security_group_rules [ 753.627330] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f43167c6-5d75-4a22-ac5d-d671524fba53 with Priority: HIGHEST for action security_group_rules [ 753.627685] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f43167c6-5d75-4a22-ac5d-d671524fba53 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.627993] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.062302] env[70013]: INFO networking_nsxv3.common.synchronization [None req-03b9ba4d-81ce-45aa-862d-28d71d4855ce None None] Enqueued Resource ID: 1e6d3d40-92c9-4ab8-a555-a69354cba07d with Priority: HIGHEST for action port [ 754.062457] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e6d3d40-92c9-4ab8-a555-a69354cba07d with Priority: HIGHEST for action port [ 754.062999] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e6d3d40-92c9-4ab8-a555-a69354cba07d taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.063138] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e6d3d40-92c9-4ab8-a555-a69354cba07d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.063208] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e6d3d40-92c9-4ab8-a555-a69354cba07d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.063464] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e6d3d40-92c9-4ab8-a555-a69354cba07d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.063562] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e6d3d40-92c9-4ab8-a555-a69354cba07d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.066520] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.066520] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.066626] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.066727] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.066816] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.066904] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f43167c6-5d75-4a22-ac5d-d671524fba53 already deleted. [ 754.066984] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.067366] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.067594] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.067594] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f43167c6-5d75-4a22-ac5d-d671524fba53',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.565527] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e6d3d40-92c9-4ab8-a555-a69354cba07d [ 754.565813] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.565891] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.565963] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.566189] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.566282] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.566377] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e6d3d40-92c9-4ab8-a555-a69354cba07d already deleted. [ 754.566457] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e6d3d40-92c9-4ab8-a555-a69354cba07d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.585620] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.585794] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.585898] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.586145] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.586262] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.586378] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f43167c6-5d75-4a22-ac5d-d671524fba53 already deleted. [ 754.586508] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.063891] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 759.064215] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 762.183410] env[70013]: INFO networking_nsxv3.common.synchronization [req-89d25183-151e-470b-8441-0ba885579fb3 req-e79fd9b2-dd47-4bc2-ac60-15bdbdcc53eb tempest-VolumesAdminNegativeTest-973826376 tempest-VolumesAdminNegativeTest-973826376-project-member] Enqueued Resource ID: 241d44e1-a518-45b5-b573-837dd908054f with Priority: HIGHEST for action security_group_members [ 762.183963] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 241d44e1-a518-45b5-b573-837dd908054f with Priority: HIGHEST for action security_group_members [ 762.184286] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-241d44e1-a518-45b5-b573-837dd908054f taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.184444] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.184511] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.184750] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.184904] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.185009] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.185075] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.185221] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.185307] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.185399] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('241d44e1-a518-45b5-b573-837dd908054f',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.458184] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-187 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.458378] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-187" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.458567] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-187" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.458851] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-187" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.459648] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.459946] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.459996] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.461389] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.461389] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.461389] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 762.461389] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 762.461389] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 762.461389] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 762.461389] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 762.461389] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 762.461389] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 762.481046] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 762.481046] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 762.481046] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 762.481256] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-187" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.482646] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-c2d9bed7-29b7-41c5-9e01-b47d54359ea0 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.482840] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-c2d9bed7-29b7-41c5-9e01-b47d54359ea0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.482840] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-c2d9bed7-29b7-41c5-9e01-b47d54359ea0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.484115] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-c2d9bed7-29b7-41c5-9e01-b47d54359ea0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.484115] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2d9bed7-29b7-41c5-9e01-b47d54359ea0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.689424] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.689424] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.689424] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.689621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.690599] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.690599] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.690599] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.690599] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.690599] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.690599] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.690599] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 241d44e1-a518-45b5-b573-837dd908054f already deleted. [ 762.690599] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.988047] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.988391] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.988391] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.988673] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.988901] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.989137] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port c2d9bed7-29b7-41c5-9e01-b47d54359ea0 not found, creating... [ 762.989409] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.989589] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.989726] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.989963] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.990118] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.990403] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.990554] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.990668] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.990871] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.991006] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.991153] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: c2d9bed7-29b7-41c5-9e01-b47d54359ea0 is going to be created. [ 763.010661] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.010868] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.010988] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.011264] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.011533] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.011717] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-c2d9bed7-29b7-41c5-9e01-b47d54359ea0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.701260] env[70013]: INFO networking_nsxv3.common.synchronization [req-89d25183-151e-470b-8441-0ba885579fb3 req-e2f8789a-ab73-4e7d-a9a6-70aea1cefa22 service nova] Enqueued Resource ID: 241d44e1-a518-45b5-b573-837dd908054f with Priority: HIGHEST for action security_group_rules [ 763.701260] env[70013]: INFO networking_nsxv3.common.synchronization [req-89d25183-151e-470b-8441-0ba885579fb3 req-e2f8789a-ab73-4e7d-a9a6-70aea1cefa22 service nova] Enqueued Resource ID: 241d44e1-a518-45b5-b573-837dd908054f with Priority: HIGHEST for action security_group_members [ 763.701260] env[70013]: INFO networking_nsxv3.common.synchronization [req-89d25183-151e-470b-8441-0ba885579fb3 req-e2f8789a-ab73-4e7d-a9a6-70aea1cefa22 service nova] Enqueued Resource ID: c2d9bed7-29b7-41c5-9e01-b47d54359ea0 with Priority: HIGHEST for action port [ 763.701667] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 241d44e1-a518-45b5-b573-837dd908054f with Priority: HIGHEST for action security_group_rules [ 763.701667] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 241d44e1-a518-45b5-b573-837dd908054f with Priority: HIGHEST for action security_group_members [ 763.701667] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d9bed7-29b7-41c5-9e01-b47d54359ea0 with Priority: HIGHEST for action port [ 763.701918] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-241d44e1-a518-45b5-b573-837dd908054f taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.702449] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.702543] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.703301] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.703301] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('241d44e1-a518-45b5-b573-837dd908054f',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.703678] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-241d44e1-a518-45b5-b573-837dd908054f taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.704059] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.704059] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.704059] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.704205] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.704263] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.704321] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.704455] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.705026] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.705026] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('241d44e1-a518-45b5-b573-837dd908054f',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.705316] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2d9bed7-29b7-41c5-9e01-b47d54359ea0 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.705728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2d9bed7-29b7-41c5-9e01-b47d54359ea0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.705798] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2d9bed7-29b7-41c5-9e01-b47d54359ea0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.706105] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2d9bed7-29b7-41c5-9e01-b47d54359ea0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.706105] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2d9bed7-29b7-41c5-9e01-b47d54359ea0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.207790] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-241d44e1-a518-45b5-b573-837dd908054f taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.207933] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.213370] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('241d44e1-a518-45b5-b573-837dd908054f',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.214340] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2d9bed7-29b7-41c5-9e01-b47d54359ea0 with status ACTIVE [ 764.214543] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.214665] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.214807] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.214942] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.215047] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.215228] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.215336] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.215391] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.215538] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.215650] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.215788] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.215881] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.215940] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.216097] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.216167] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.216253] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2d9bed7-29b7-41c5-9e01-b47d54359ea0 is going to be updated. [ 764.237046] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.237205] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.237205] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.237354] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.237487] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.237637] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2d9bed7-29b7-41c5-9e01-b47d54359ea0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.719699] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('241d44e1-a518-45b5-b573-837dd908054f',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.049200] env[70013]: INFO networking_nsxv3.common.synchronization [req-de52e49b-103f-4164-8383-0ba10f8c18c6 req-ab10de45-d527-4702-b721-c37a9bd68733 tempest-ServerActionsV293TestJSON-1916911121 tempest-ServerActionsV293TestJSON-1916911121-project-member] Enqueued Resource ID: 48314c78-ef82-4312-9437-4a43cc3de63d with Priority: HIGHEST for action security_group_members [ 765.050120] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48314c78-ef82-4312-9437-4a43cc3de63d with Priority: HIGHEST for action security_group_members [ 765.051079] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-48314c78-ef82-4312-9437-4a43cc3de63d taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.051512] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48314c78-ef82-4312-9437-4a43cc3de63d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.051694] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48314c78-ef82-4312-9437-4a43cc3de63d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.053683] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48314c78-ef82-4312-9437-4a43cc3de63d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.053683] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.053683] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.053683] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.053683] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.053683] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.053683] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48314c78-ef82-4312-9437-4a43cc3de63d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.227025] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.227142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.227142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.227364] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.227457] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.227680] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 241d44e1-a518-45b5-b573-837dd908054f is going to be created. [ 765.252627] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.252627] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.252627] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.252627] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.252627] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.263440] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 241d44e1-a518-45b5-b573-837dd908054f in Status: UNINITIALIZED for 2s [ 765.382847] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-612 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.383051] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-612" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.383176] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-612" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.383512] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-612" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.383767] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.383944] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.384123] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.384420] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.384579] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.384789] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 765.384903] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 765.385017] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 765.385129] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 765.385242] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 765.385400] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 765.385465] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 765.404611] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 765.404737] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 765.404883] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 765.406048] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-612" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.406048] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-c6bd89ff-30f7-46ff-b392-16a88577740a taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.406048] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-c6bd89ff-30f7-46ff-b392-16a88577740a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.406048] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-c6bd89ff-30f7-46ff-b392-16a88577740a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.406048] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-c6bd89ff-30f7-46ff-b392-16a88577740a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.406280] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6bd89ff-30f7-46ff-b392-16a88577740a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.558827] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.559025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.559099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.559263] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.559371] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.559583] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.559678] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.559733] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.559885] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.559961] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.560095] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48314c78-ef82-4312-9437-4a43cc3de63d already deleted. [ 765.560145] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48314c78-ef82-4312-9437-4a43cc3de63d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.911121] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.911561] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.911561] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.911774] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.911922] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.912115] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port c6bd89ff-30f7-46ff-b392-16a88577740a not found, creating... [ 765.912378] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.912533] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.912647] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.912859] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.912997] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.913288] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.913438] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.913553] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.913751] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.913878] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.915237] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: c6bd89ff-30f7-46ff-b392-16a88577740a is going to be created. [ 765.936323] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.936515] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.936633] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.936907] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.937138] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.937389] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-c6bd89ff-30f7-46ff-b392-16a88577740a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.055713] env[70013]: INFO networking_nsxv3.common.synchronization [req-de52e49b-103f-4164-8383-0ba10f8c18c6 req-c395054a-e670-4d0d-ab6e-5b77c4b46c15 service nova] Enqueued Resource ID: 48314c78-ef82-4312-9437-4a43cc3de63d with Priority: HIGHEST for action security_group_rules [ 767.055991] env[70013]: INFO networking_nsxv3.common.synchronization [req-de52e49b-103f-4164-8383-0ba10f8c18c6 req-c395054a-e670-4d0d-ab6e-5b77c4b46c15 service nova] Enqueued Resource ID: 48314c78-ef82-4312-9437-4a43cc3de63d with Priority: HIGHEST for action security_group_members [ 767.056134] env[70013]: INFO networking_nsxv3.common.synchronization [req-de52e49b-103f-4164-8383-0ba10f8c18c6 req-c395054a-e670-4d0d-ab6e-5b77c4b46c15 service nova] Enqueued Resource ID: c6bd89ff-30f7-46ff-b392-16a88577740a with Priority: HIGHEST for action port [ 767.056625] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48314c78-ef82-4312-9437-4a43cc3de63d with Priority: HIGHEST for action security_group_rules [ 767.056758] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48314c78-ef82-4312-9437-4a43cc3de63d with Priority: HIGHEST for action security_group_members [ 767.056857] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6bd89ff-30f7-46ff-b392-16a88577740a with Priority: HIGHEST for action port [ 767.057481] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48314c78-ef82-4312-9437-4a43cc3de63d taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.057643] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48314c78-ef82-4312-9437-4a43cc3de63d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.057758] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48314c78-ef82-4312-9437-4a43cc3de63d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.057985] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48314c78-ef82-4312-9437-4a43cc3de63d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.058492] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48314c78-ef82-4312-9437-4a43cc3de63d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.059681] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-48314c78-ef82-4312-9437-4a43cc3de63d taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.060029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48314c78-ef82-4312-9437-4a43cc3de63d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.060612] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48314c78-ef82-4312-9437-4a43cc3de63d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.060846] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48314c78-ef82-4312-9437-4a43cc3de63d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.061103] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.061246] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.061355] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.061548] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.062153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.062332] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48314c78-ef82-4312-9437-4a43cc3de63d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.066346] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6bd89ff-30f7-46ff-b392-16a88577740a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.066346] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6bd89ff-30f7-46ff-b392-16a88577740a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.066346] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6bd89ff-30f7-46ff-b392-16a88577740a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.066346] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6bd89ff-30f7-46ff-b392-16a88577740a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.066346] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6bd89ff-30f7-46ff-b392-16a88577740a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.270513] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 241d44e1-a518-45b5-b573-837dd908054f in Status: SUCCESS [ 767.270728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.270899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.271161] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.271430] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.271561] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.271629] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.271794] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.271920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.271950] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.272055] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('241d44e1-a518-45b5-b573-837dd908054f',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.568398] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('48314c78-ef82-4312-9437-4a43cc3de63d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.569469] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-48314c78-ef82-4312-9437-4a43cc3de63d taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.569574] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48314c78-ef82-4312-9437-4a43cc3de63d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.569723] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6bd89ff-30f7-46ff-b392-16a88577740a with status ACTIVE [ 767.570300] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.570300] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.570300] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.570300] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.570506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.570506] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.570614] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.570674] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.570838] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.570929] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.571124] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.571220] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.571283] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.571432] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.571510] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.571632] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6bd89ff-30f7-46ff-b392-16a88577740a is going to be updated. [ 767.597210] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.597348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.597465] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.597608] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.597786] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.597894] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6bd89ff-30f7-46ff-b392-16a88577740a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.774846] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-241d44e1-a518-45b5-b573-837dd908054f taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.777833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.777833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.777833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.777833] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.777833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.777833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.777833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.777833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.777833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.777833] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-241d44e1-a518-45b5-b573-837dd908054f taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.777833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.777833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.777833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.777833] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.777833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.777833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.777833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.777833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.778647] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.778647] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('241d44e1-a518-45b5-b573-837dd908054f',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.079605] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('48314c78-ef82-4312-9437-4a43cc3de63d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.280503] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 241d44e1-a518-45b5-b573-837dd908054f: rpc.has_security_group_logging(os_id): False [ 768.305062] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.305219] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.305291] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.305506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.305606] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.305860] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.305913] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.305974] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.306141] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.306256] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.306404] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.307063] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.307063] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.307063] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.307063] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.308208] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.309668] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.309668] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.309668] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.309668] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.309668] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 241d44e1-a518-45b5-b573-837dd908054f is going to be created. [ 768.360572] env[70013]: INFO networking_nsxv3.common.synchronization [None req-52f79218-d3bb-44df-9be9-ac07a5f20118 tempest-MigrationsAdminTest-81604366 tempest-MigrationsAdminTest-81604366-project-member] Enqueued Resource ID: 89196864-9e81-43ac-81a1-61781a3e4411 with Priority: HIGHEST for action security_group_rules [ 768.360572] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89196864-9e81-43ac-81a1-61781a3e4411 with Priority: HIGHEST for action security_group_rules [ 768.360572] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89196864-9e81-43ac-81a1-61781a3e4411 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.360572] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89196864-9e81-43ac-81a1-61781a3e4411" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.360572] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89196864-9e81-43ac-81a1-61781a3e4411" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.360827] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89196864-9e81-43ac-81a1-61781a3e4411" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.360861] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89196864-9e81-43ac-81a1-61781a3e4411',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.385018] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.385018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.385018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.385018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.385018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.396729] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 241d44e1-a518-45b5-b573-837dd908054f in Status: IN_PROGRESS for 2s [ 768.491280] env[70013]: INFO networking_nsxv3.common.synchronization [None req-46d97988-6073-4c7d-b93b-e243634632d7 tempest-MigrationsAdminTest-81604366 tempest-MigrationsAdminTest-81604366-project-member] Enqueued Resource ID: 89196864-9e81-43ac-81a1-61781a3e4411 with Priority: HIGHEST for action security_group_rules [ 768.491809] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89196864-9e81-43ac-81a1-61781a3e4411 with Priority: HIGHEST for action security_group_rules [ 768.492117] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89196864-9e81-43ac-81a1-61781a3e4411 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.492821] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89196864-9e81-43ac-81a1-61781a3e4411" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.582860] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.583050] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.583124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.583383] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.583529] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.583652] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48314c78-ef82-4312-9437-4a43cc3de63d is going to be created. [ 768.606831] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.607167] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.607304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.607694] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.607856] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.618551] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48314c78-ef82-4312-9437-4a43cc3de63d in Status: UNINITIALIZED for 2s [ 768.881433] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.881655] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.881753] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.881988] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.882113] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.882216] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89196864-9e81-43ac-81a1-61781a3e4411 already deleted. [ 768.882303] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89196864-9e81-43ac-81a1-61781a3e4411" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.882608] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89196864-9e81-43ac-81a1-61781a3e4411" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.882847] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89196864-9e81-43ac-81a1-61781a3e4411" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.883075] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89196864-9e81-43ac-81a1-61781a3e4411',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.403922] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.403922] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.403922] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.403922] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.403922] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.403922] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89196864-9e81-43ac-81a1-61781a3e4411 already deleted. [ 769.404504] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89196864-9e81-43ac-81a1-61781a3e4411" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.411804] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 241d44e1-a518-45b5-b573-837dd908054f in Status: SUCCESS [ 770.412090] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.628884] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48314c78-ef82-4312-9437-4a43cc3de63d in Status: SUCCESS [ 770.629258] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48314c78-ef82-4312-9437-4a43cc3de63d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.629323] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48314c78-ef82-4312-9437-4a43cc3de63d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.629565] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48314c78-ef82-4312-9437-4a43cc3de63d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.629751] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.629875] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.629942] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.633030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.633030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.633030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48314c78-ef82-4312-9437-4a43cc3de63d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.633030] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('48314c78-ef82-4312-9437-4a43cc3de63d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.663287] env[70013]: INFO networking_nsxv3.common.synchronization [None req-5830c154-4158-4bd3-9114-c8d2104df732 None None] Enqueued Resource ID: 1bb6033b-3362-4755-a20c-f682fd9cff48 with Priority: HIGHEST for action port [ 770.663542] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb6033b-3362-4755-a20c-f682fd9cff48 with Priority: HIGHEST for action port [ 770.664199] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-1bb6033b-3362-4755-a20c-f682fd9cff48 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.664274] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1bb6033b-3362-4755-a20c-f682fd9cff48" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.664331] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1bb6033b-3362-4755-a20c-f682fd9cff48" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.664591] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1bb6033b-3362-4755-a20c-f682fd9cff48" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.664668] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bb6033b-3362-4755-a20c-f682fd9cff48',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.133905] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('48314c78-ef82-4312-9437-4a43cc3de63d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.169819] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1bb6033b-3362-4755-a20c-f682fd9cff48 [ 771.169819] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.169819] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.169819] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.169819] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.169819] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.169819] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1bb6033b-3362-4755-a20c-f682fd9cff48 already deleted. [ 771.169819] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1bb6033b-3362-4755-a20c-f682fd9cff48" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.636519] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 48314c78-ef82-4312-9437-4a43cc3de63d: rpc.has_security_group_logging(os_id): False [ 771.665246] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.665246] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.665246] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.665246] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.665246] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.665246] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.665246] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.665246] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.665246] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.665246] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.665821] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48314c78-ef82-4312-9437-4a43cc3de63d is going to be created. [ 771.741469] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.741469] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.741469] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.741655] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.741720] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.754285] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48314c78-ef82-4312-9437-4a43cc3de63d in Status: IN_PROGRESS for 2s [ 772.613368] env[70013]: INFO networking_nsxv3.common.synchronization [req-0a3e13cb-b09a-462d-aa20-f4bbd46e41bd req-510aa85c-7497-48b0-8dec-603826f56295 tempest-ServersTestBootFromVolume-2114082365 tempest-ServersTestBootFromVolume-2114082365-project-member] Enqueued Resource ID: 9327e489-f357-4ab4-ad7d-eea2d96da52c with Priority: HIGHEST for action security_group_members [ 772.613926] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9327e489-f357-4ab4-ad7d-eea2d96da52c with Priority: HIGHEST for action security_group_members [ 772.614254] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9327e489-f357-4ab4-ad7d-eea2d96da52c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.614375] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.614446] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.614689] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.614887] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.614989] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.615198] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.615391] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.618176] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.618176] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9327e489-f357-4ab4-ad7d-eea2d96da52c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.881945] env[70013]: INFO networking_nsxv3.common.synchronization [None req-bc8ce120-0f07-4002-b2cb-351d20d11556 None None] Enqueued Resource ID: 3568ef30-885c-42c2-9ec2-916543a058dc with Priority: HIGHEST for action port [ 772.882665] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3568ef30-885c-42c2-9ec2-916543a058dc with Priority: HIGHEST for action port [ 772.883065] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-3568ef30-885c-42c2-9ec2-916543a058dc taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.883144] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3568ef30-885c-42c2-9ec2-916543a058dc" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.883401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3568ef30-885c-42c2-9ec2-916543a058dc" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.883608] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3568ef30-885c-42c2-9ec2-916543a058dc" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.883608] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3568ef30-885c-42c2-9ec2-916543a058dc',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.026132] env[70013]: INFO networking_nsxv3.common.synchronization [req-bde01fce-1464-48f9-b3a0-6b8cf887f6d2 req-3786f8d1-bb09-4708-aa3e-cf13cd61a0e6 tempest-ServerDiagnosticsTest-382342043 tempest-ServerDiagnosticsTest-382342043-project-member] Enqueued Resource ID: 12839468-1e74-4c74-abf4-73e096a46e61 with Priority: HIGHEST for action security_group_members [ 773.026749] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12839468-1e74-4c74-abf4-73e096a46e61 with Priority: HIGHEST for action security_group_members [ 773.026976] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-12839468-1e74-4c74-abf4-73e096a46e61 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.027106] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.027179] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.027416] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.027561] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.027672] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.027765] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.027974] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.027974] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.028193] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12839468-1e74-4c74-abf4-73e096a46e61',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.118632] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.118782] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.119043] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.119100] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.119158] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.119413] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.119530] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.119590] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.119740] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.119815] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.119895] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9327e489-f357-4ab4-ad7d-eea2d96da52c is going to be updated. [ 773.153020] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.153020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.153020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.153020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.153020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.161429] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9327e489-f357-4ab4-ad7d-eea2d96da52c in Status: IN_PROGRESS for 2s [ 773.338195] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-701 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.338195] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.338195] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.338195] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.338195] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.338195] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.338623] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.338681] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.338865] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.339124] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 773.339271] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 773.339435] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 773.339573] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 773.339711] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 773.339845] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 773.340085] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 773.363887] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 773.363887] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 773.363887] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 773.363887] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.363887] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-8b3dcf6d-4b21-4944-82c6-08f6ffcf6e2e taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.363887] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-8b3dcf6d-4b21-4944-82c6-08f6ffcf6e2e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.363887] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-8b3dcf6d-4b21-4944-82c6-08f6ffcf6e2e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.363887] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-8b3dcf6d-4b21-4944-82c6-08f6ffcf6e2e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.363887] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b3dcf6d-4b21-4944-82c6-08f6ffcf6e2e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.389017] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3568ef30-885c-42c2-9ec2-916543a058dc [ 773.389275] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.389412] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.389492] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.389714] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.389808] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.389905] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3568ef30-885c-42c2-9ec2-916543a058dc already deleted. [ 773.389988] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3568ef30-885c-42c2-9ec2-916543a058dc" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.530462] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.531711] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.531711] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.531711] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.531711] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.531711] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.531711] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.531711] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.531711] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.531711] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.532123] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12839468-1e74-4c74-abf4-73e096a46e61 already deleted. [ 773.532123] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.766867] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 48314c78-ef82-4312-9437-4a43cc3de63d in Status: SUCCESS [ 773.767156] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48314c78-ef82-4312-9437-4a43cc3de63d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.872020] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.872020] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.872020] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.872020] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.872020] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.872020] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 8b3dcf6d-4b21-4944-82c6-08f6ffcf6e2e not found, creating... [ 773.872020] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.872020] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.872020] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.872020] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.872020] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.872434] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.872434] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.872434] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.873311] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.873599] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.873870] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 8b3dcf6d-4b21-4944-82c6-08f6ffcf6e2e is going to be created. [ 773.896181] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.896458] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.897614] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.897614] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.897856] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.898144] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-8b3dcf6d-4b21-4944-82c6-08f6ffcf6e2e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.661029] env[70013]: INFO networking_nsxv3.common.synchronization [req-bde01fce-1464-48f9-b3a0-6b8cf887f6d2 req-bb06f3a1-50b4-43ae-a38e-37eb5e31e397 service nova] Enqueued Resource ID: 12839468-1e74-4c74-abf4-73e096a46e61 with Priority: HIGHEST for action security_group_rules [ 774.661205] env[70013]: INFO networking_nsxv3.common.synchronization [req-bde01fce-1464-48f9-b3a0-6b8cf887f6d2 req-bb06f3a1-50b4-43ae-a38e-37eb5e31e397 service nova] Enqueued Resource ID: 12839468-1e74-4c74-abf4-73e096a46e61 with Priority: HIGHEST for action security_group_members [ 774.661337] env[70013]: INFO networking_nsxv3.common.synchronization [req-bde01fce-1464-48f9-b3a0-6b8cf887f6d2 req-bb06f3a1-50b4-43ae-a38e-37eb5e31e397 service nova] Enqueued Resource ID: 8b3dcf6d-4b21-4944-82c6-08f6ffcf6e2e with Priority: HIGHEST for action port [ 774.661606] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12839468-1e74-4c74-abf4-73e096a46e61 with Priority: HIGHEST for action security_group_rules [ 774.661742] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12839468-1e74-4c74-abf4-73e096a46e61 with Priority: HIGHEST for action security_group_members [ 774.663384] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b3dcf6d-4b21-4944-82c6-08f6ffcf6e2e with Priority: HIGHEST for action port [ 774.663384] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12839468-1e74-4c74-abf4-73e096a46e61 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.663384] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.663384] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.663384] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.663384] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12839468-1e74-4c74-abf4-73e096a46e61',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.664827] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-12839468-1e74-4c74-abf4-73e096a46e61 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.665260] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.665366] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.665724] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.665724] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.665866] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.665866] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.665951] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.666396] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.666396] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12839468-1e74-4c74-abf4-73e096a46e61',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.670657] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b3dcf6d-4b21-4944-82c6-08f6ffcf6e2e taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.670778] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b3dcf6d-4b21-4944-82c6-08f6ffcf6e2e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.670953] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b3dcf6d-4b21-4944-82c6-08f6ffcf6e2e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.671045] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b3dcf6d-4b21-4944-82c6-08f6ffcf6e2e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.671129] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b3dcf6d-4b21-4944-82c6-08f6ffcf6e2e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.175094] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9327e489-f357-4ab4-ad7d-eea2d96da52c in Status: SUCCESS [ 775.175423] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9327e489-f357-4ab4-ad7d-eea2d96da52c deletion is rescheduled due to dependency. [ 775.175563] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.175905] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-12839468-1e74-4c74-abf4-73e096a46e61 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.176011] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.176238] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12839468-1e74-4c74-abf4-73e096a46e61',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.177190] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b3dcf6d-4b21-4944-82c6-08f6ffcf6e2e with status ACTIVE [ 775.177426] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.177539] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.177606] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.177829] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.177870] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.178362] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.179434] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.179562] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.179765] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.179884] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.180201] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.180401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.183144] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.183410] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.183471] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.183592] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b3dcf6d-4b21-4944-82c6-08f6ffcf6e2e is going to be updated. [ 775.221016] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.221205] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.221324] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.221643] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.221813] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.222010] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b3dcf6d-4b21-4944-82c6-08f6ffcf6e2e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.653397] env[70013]: INFO networking_nsxv3.common.synchronization [req-4edd1b86-297d-4398-b6d1-c4c494ea9bca req-d84dda03-59fe-4eeb-a8d2-9371e669f717 tempest-ServersTestMultiNic-1935476789 tempest-ServersTestMultiNic-1935476789-project-member] Enqueued Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 775.653993] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 775.654317] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.654536] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.654536] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.654763] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.654911] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.656223] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.656388] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.656553] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.656699] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.656818] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.690375] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12839468-1e74-4c74-abf4-73e096a46e61',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.082026] env[70013]: INFO networking_nsxv3.common.synchronization [req-4edd1b86-297d-4398-b6d1-c4c494ea9bca req-a58f1ee3-bf62-4c63-b630-bd056ef72924 tempest-ServersTestMultiNic-1935476789 tempest-ServersTestMultiNic-1935476789-project-member] Enqueued Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 776.082593] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 776.082899] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.083006] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.160078] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.160078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.160183] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.160326] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.160421] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.160611] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.160704] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.160765] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.160909] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.160984] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.161088] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86efc288-b26f-4298-9444-58202b5c40d5 already deleted. [ 776.161169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.166018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.166018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.166018] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.166018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.166018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.166018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.166018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.166018] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.169758] env[70013]: INFO networking_nsxv3.common.synchronization [req-0602c3e1-8d09-42a1-933d-ef69b164ac49 req-f758f7f9-df05-4b34-85ce-998251d8df60 tempest-VolumesAdminNegativeTest-973826376 tempest-VolumesAdminNegativeTest-973826376-project-member] Enqueued Resource ID: 241d44e1-a518-45b5-b573-837dd908054f with Priority: HIGHEST for action security_group_members [ 776.170519] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 241d44e1-a518-45b5-b573-837dd908054f with Priority: HIGHEST for action security_group_members [ 776.170823] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-241d44e1-a518-45b5-b573-837dd908054f taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.170930] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.170996] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.171248] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.171437] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.171545] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.172739] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.172739] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.172739] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.172739] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('241d44e1-a518-45b5-b573-837dd908054f',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.193123] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.193123] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.193123] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.193123] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.193123] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.193621] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12839468-1e74-4c74-abf4-73e096a46e61 is going to be created. [ 776.219434] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.219586] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.219648] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.219858] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.220045] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.230111] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12839468-1e74-4c74-abf4-73e096a46e61 in Status: UNINITIALIZED for 2s [ 776.439329] env[70013]: INFO networking_nsxv3.common.synchronization [req-4edd1b86-297d-4398-b6d1-c4c494ea9bca req-2d63849a-6d93-4bf9-8837-b9b9e1ac3c9b tempest-ServersTestMultiNic-1935476789 tempest-ServersTestMultiNic-1935476789-project-member] Enqueued Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 776.441086] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 776.441086] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.441086] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.671470] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.673061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.673061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.673061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.673061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.673061] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.673061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.673061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.673061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.673061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.673457] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86efc288-b26f-4298-9444-58202b5c40d5 already deleted. [ 776.673457] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.673783] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.673941] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.674019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.674232] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.674341] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.674595] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.674742] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.674858] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.675129] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.675263] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.675456] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 241d44e1-a518-45b5-b573-837dd908054f is going to be updated. [ 776.676639] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.676874] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.677183] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.677298] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.677376] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.677567] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.677680] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.677804] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.706697] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.706913] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.707069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.707372] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.707547] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.717268] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 241d44e1-a518-45b5-b573-837dd908054f in Status: IN_PROGRESS for 2s [ 777.020100] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-860 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.020100] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-860" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.020100] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-860" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.020100] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-860" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.020100] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.020100] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.020100] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.020100] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.020100] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.020100] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 777.020699] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 777.020973] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 777.021252] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 777.022362] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 777.022547] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 777.022707] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 777.040531] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 777.040678] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 777.040808] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 777.041064] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-860" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.041370] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-58a7c4b8-c855-465c-8f72-5d93eccdbb81 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.041591] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-58a7c4b8-c855-465c-8f72-5d93eccdbb81" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.041716] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-58a7c4b8-c855-465c-8f72-5d93eccdbb81" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.042245] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-58a7c4b8-c855-465c-8f72-5d93eccdbb81" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.042379] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58a7c4b8-c855-465c-8f72-5d93eccdbb81',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.180630] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.180709] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.180763] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.180979] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.181099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.181297] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.181397] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.181484] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.181647] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.181727] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.181813] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86efc288-b26f-4298-9444-58202b5c40d5 already deleted. [ 777.181891] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.548213] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.548213] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.548213] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.548213] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.548213] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.548213] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 58a7c4b8-c855-465c-8f72-5d93eccdbb81 not found, creating... [ 777.548213] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.548213] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.548213] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.548213] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.548213] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.548995] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.548995] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.548995] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.548995] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.548995] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.548995] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 58a7c4b8-c855-465c-8f72-5d93eccdbb81 is going to be created. [ 777.572548] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.572733] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.572889] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.573191] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.573429] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.573697] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-58a7c4b8-c855-465c-8f72-5d93eccdbb81" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.242890] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12839468-1e74-4c74-abf4-73e096a46e61 in Status: SUCCESS [ 778.242890] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.242890] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.243265] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.243265] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.243393] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.243393] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.245439] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.245439] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.245439] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.245439] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12839468-1e74-4c74-abf4-73e096a46e61',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.728210] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 241d44e1-a518-45b5-b573-837dd908054f in Status: SUCCESS [ 778.728510] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 241d44e1-a518-45b5-b573-837dd908054f deletion is rescheduled due to dependency. [ 778.728510] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.748156] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-12839468-1e74-4c74-abf4-73e096a46e61 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.748323] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.748399] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.748626] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.748819] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.748920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.748982] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.749170] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.749258] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.749349] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.749509] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-12839468-1e74-4c74-abf4-73e096a46e61 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.749605] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.749667] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.749810] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.749947] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.750052] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.750115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.750274] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.750352] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.750470] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.750518] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12839468-1e74-4c74-abf4-73e096a46e61',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.863675] env[70013]: INFO networking_nsxv3.common.synchronization [req-4edd1b86-297d-4398-b6d1-c4c494ea9bca req-460ab6fb-7eee-43ae-ab6a-103433e180f5 service nova] Enqueued Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_rules [ 778.864520] env[70013]: INFO networking_nsxv3.common.synchronization [req-4edd1b86-297d-4398-b6d1-c4c494ea9bca req-460ab6fb-7eee-43ae-ab6a-103433e180f5 service nova] Enqueued Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 778.864856] env[70013]: INFO networking_nsxv3.common.synchronization [req-4edd1b86-297d-4398-b6d1-c4c494ea9bca req-460ab6fb-7eee-43ae-ab6a-103433e180f5 service nova] Enqueued Resource ID: 58a7c4b8-c855-465c-8f72-5d93eccdbb81 with Priority: HIGHEST for action port [ 778.865650] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_rules [ 778.866064] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 778.866867] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58a7c4b8-c855-465c-8f72-5d93eccdbb81 with Priority: HIGHEST for action port [ 778.866867] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.866867] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.866867] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.867244] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.867244] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.868634] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.868740] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.868813] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.868996] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.869157] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.869253] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.869328] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.869566] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.869599] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.869691] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.870446] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-58a7c4b8-c855-465c-8f72-5d93eccdbb81 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.870555] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58a7c4b8-c855-465c-8f72-5d93eccdbb81" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.870616] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58a7c4b8-c855-465c-8f72-5d93eccdbb81" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.870790] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58a7c4b8-c855-465c-8f72-5d93eccdbb81" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.870863] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58a7c4b8-c855-465c-8f72-5d93eccdbb81',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.874808] env[70013]: INFO networking_nsxv3.common.synchronization [req-fcc6b87f-d701-4e73-8f4e-1d75a611da70 req-46475c45-dd0e-4c15-a74b-bf1e9f4e8b66 tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_members [ 778.874808] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_members [ 778.874808] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.874808] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.877166] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.877414] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.877573] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.877692] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.877806] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.877894] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.877981] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.878084] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.253093] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12839468-1e74-4c74-abf4-73e096a46e61: rpc.has_security_group_logging(os_id): False [ 779.272283] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.272632] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.274575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.274575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.274575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.274575] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.274575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.274575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.274575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.274575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.274575] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.274575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.274575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.274575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.274575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.274575] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.275308] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.278168] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.278397] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.278494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.278595] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12839468-1e74-4c74-abf4-73e096a46e61 is going to be created. [ 779.362864] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.363081] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.363081] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.363303] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.363485] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.369122] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.369228] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.372944] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12839468-1e74-4c74-abf4-73e096a46e61 in Status: IN_PROGRESS for 2s [ 779.373221] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.380810] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.380961] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.381063] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.381273] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.381365] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.381625] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.381791] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.381791] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.381919] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.381987] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.382085] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d47d19df-e406-4c01-9cf0-1110c7c55440 already deleted. [ 779.382164] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.382344] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 58a7c4b8-c855-465c-8f72-5d93eccdbb81 with status ACTIVE [ 779.382492] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.382584] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.382646] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.382777] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.382843] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.382998] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.383099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.383157] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.383386] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.383386] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.383542] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.383621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.383674] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.383788] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.383849] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.383934] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 58a7c4b8-c855-465c-8f72-5d93eccdbb81 is going to be updated. [ 779.409918] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.410118] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.410118] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.410327] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.410462] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.410617] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58a7c4b8-c855-465c-8f72-5d93eccdbb81" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.876322] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.970565] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-539 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.970768] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-539" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.970925] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-539" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.971307] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-539" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.971623] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.971786] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.971899] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.972249] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.972407] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.972669] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 779.972785] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 779.972898] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 779.973011] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 779.973130] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 779.973234] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 779.973365] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 779.990158] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 779.990391] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 779.990606] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 779.990799] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-539" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.991166] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-ce671578-5542-4458-8bd2-c23e89aa5b61 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.991342] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-ce671578-5542-4458-8bd2-c23e89aa5b61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.991482] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-ce671578-5542-4458-8bd2-c23e89aa5b61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.991801] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-ce671578-5542-4458-8bd2-c23e89aa5b61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.991943] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce671578-5542-4458-8bd2-c23e89aa5b61',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.104548] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-762 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.104761] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-762" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.104885] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-762" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.105245] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-762" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.105504] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.105661] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.105776] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.106994] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.107195] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.107422] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 780.107961] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 780.108125] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 780.108249] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 780.108375] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 780.108489] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 780.108784] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 780.127748] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 780.127991] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 780.128198] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 780.128427] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-762" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.128837] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-2a10027e-1a93-40ca-a079-297eb6af7618 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.129115] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-2a10027e-1a93-40ca-a079-297eb6af7618" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.129286] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-2a10027e-1a93-40ca-a079-297eb6af7618" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.130043] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-2a10027e-1a93-40ca-a079-297eb6af7618" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.130212] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a10027e-1a93-40ca-a079-297eb6af7618',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.381188] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.381883] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.381883] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.381883] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.381883] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.382026] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86efc288-b26f-4298-9444-58202b5c40d5 is going to be created. [ 780.405476] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.405713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.405713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.405953] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.406148] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.416362] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: UNINITIALIZED for 2s [ 780.496657] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.496657] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.496820] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.499050] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.499050] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.499050] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port ce671578-5542-4458-8bd2-c23e89aa5b61 not found, creating... [ 780.499050] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.499050] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.499050] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.499050] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.499050] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.499050] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.499050] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.500523] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.500523] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.500523] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.500523] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: ce671578-5542-4458-8bd2-c23e89aa5b61 is going to be created. [ 780.520842] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.521060] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.521186] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.521485] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.521702] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.521924] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-ce671578-5542-4458-8bd2-c23e89aa5b61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.634324] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.634646] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.634737] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.635322] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.635322] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.635424] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 2a10027e-1a93-40ca-a079-297eb6af7618 not found, creating... [ 780.635898] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.636032] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.639916] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.639916] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.640233] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.640411] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.640488] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.641037] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.641037] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.641272] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.641524] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 2a10027e-1a93-40ca-a079-297eb6af7618 is going to be created. [ 780.672352] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.672571] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.672714] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.672997] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.673249] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.673567] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-2a10027e-1a93-40ca-a079-297eb6af7618" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.269127] env[70013]: INFO networking_nsxv3.common.synchronization [req-2caed8ec-591d-4579-9059-17e0c57192e8 req-f903014b-2b66-4031-a3ba-60c65ef3925d tempest-DeleteServersTestJSON-1971284771 tempest-DeleteServersTestJSON-1971284771-project-member] Enqueued Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 781.269806] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 781.270320] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.270489] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.270584] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.270851] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.271052] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.271167] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.271229] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.271384] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.271651] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.271727] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.386023] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12839468-1e74-4c74-abf4-73e096a46e61 in Status: SUCCESS [ 781.386234] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.496366] env[70013]: INFO networking_nsxv3.common.synchronization [req-4edd1b86-297d-4398-b6d1-c4c494ea9bca req-7fef9faf-6f7f-4480-a390-b187b19443fc service nova] Enqueued Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_rules [ 781.496607] env[70013]: INFO networking_nsxv3.common.synchronization [req-4edd1b86-297d-4398-b6d1-c4c494ea9bca req-7fef9faf-6f7f-4480-a390-b187b19443fc service nova] Enqueued Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 781.496753] env[70013]: INFO networking_nsxv3.common.synchronization [req-4edd1b86-297d-4398-b6d1-c4c494ea9bca req-7fef9faf-6f7f-4480-a390-b187b19443fc service nova] Enqueued Resource ID: ce671578-5542-4458-8bd2-c23e89aa5b61 with Priority: HIGHEST for action port [ 781.496978] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_rules [ 781.497155] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 781.497260] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce671578-5542-4458-8bd2-c23e89aa5b61 with Priority: HIGHEST for action port [ 781.497998] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.498561] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.498808] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.498904] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.499176] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce671578-5542-4458-8bd2-c23e89aa5b61 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.499276] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce671578-5542-4458-8bd2-c23e89aa5b61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.499344] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce671578-5542-4458-8bd2-c23e89aa5b61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.499573] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce671578-5542-4458-8bd2-c23e89aa5b61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.499659] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce671578-5542-4458-8bd2-c23e89aa5b61',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.569864] env[70013]: INFO networking_nsxv3.common.synchronization [req-fcc6b87f-d701-4e73-8f4e-1d75a611da70 req-e8323326-69ac-46a5-9e68-797a6115b852 service nova] Enqueued Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_rules [ 781.570183] env[70013]: INFO networking_nsxv3.common.synchronization [req-fcc6b87f-d701-4e73-8f4e-1d75a611da70 req-e8323326-69ac-46a5-9e68-797a6115b852 service nova] Enqueued Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_members [ 781.570395] env[70013]: INFO networking_nsxv3.common.synchronization [req-fcc6b87f-d701-4e73-8f4e-1d75a611da70 req-e8323326-69ac-46a5-9e68-797a6115b852 service nova] Enqueued Resource ID: 2a10027e-1a93-40ca-a079-297eb6af7618 with Priority: HIGHEST for action port [ 781.570896] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_rules [ 781.571091] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_members [ 781.571226] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a10027e-1a93-40ca-a079-297eb6af7618 with Priority: HIGHEST for action port [ 781.571570] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.571759] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.571862] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.573076] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.573076] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.573722] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.573878] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.573943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.574167] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.574328] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.574513] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.574513] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.574738] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.574825] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.574871] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.576752] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a10027e-1a93-40ca-a079-297eb6af7618 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.576966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a10027e-1a93-40ca-a079-297eb6af7618" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.577056] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a10027e-1a93-40ca-a079-297eb6af7618" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.577259] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a10027e-1a93-40ca-a079-297eb6af7618" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.577421] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a10027e-1a93-40ca-a079-297eb6af7618',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.774541] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.775100] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.775182] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.775404] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.776926] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.777275] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.777425] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.777485] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.777661] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.777778] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.777897] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b is going to be updated. [ 781.794096] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-446 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.794292] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-446" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.794412] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-446" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.794691] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-446" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.794941] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.795111] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.795224] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.795432] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.795574] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.795773] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 781.795882] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 781.795987] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 781.797983] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 781.797983] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 781.797983] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 781.797983] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 781.802042] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.802163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.802274] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.802362] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.802506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.815624] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: IN_PROGRESS for 2s [ 781.822562] env[70013]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] NSXv3 Agent Agent loop - iteration:0 completed [ 781.822686] env[70013]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] NSXv3 Agent Agent loop - iteration:1 started [ 781.825982] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 781.826166] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 781.826637] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 781.826637] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-446" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.826791] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-ce1440b0-008c-48c7-b1c8-61ab26650d98 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.826957] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-ce1440b0-008c-48c7-b1c8-61ab26650d98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.827339] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-ce1440b0-008c-48c7-b1c8-61ab26650d98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.827423] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-ce1440b0-008c-48c7-b1c8-61ab26650d98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.827537] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce1440b0-008c-48c7-b1c8-61ab26650d98',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.009459] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce671578-5542-4458-8bd2-c23e89aa5b61 with status ACTIVE [ 782.009459] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.009459] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.009459] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.009459] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.009459] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.009459] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.009459] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.009459] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.009459] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.009459] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.009459] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.009459] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.009459] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.009459] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.009459] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.009459] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce671578-5542-4458-8bd2-c23e89aa5b61 is going to be updated. [ 782.034304] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.034457] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.034523] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.034748] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.034890] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.035063] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce671578-5542-4458-8bd2-c23e89aa5b61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.079367] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.079540] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.079885] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.081448] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a10027e-1a93-40ca-a079-297eb6af7618 with status ACTIVE [ 782.081730] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.081879] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.082095] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.082347] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.082480] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.082699] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.082838] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.082961] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.083182] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.083407] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.083625] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.083747] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.083827] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.084103] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.084183] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.084301] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a10027e-1a93-40ca-a079-297eb6af7618 is going to be updated. [ 782.118133] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.118133] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.118133] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.118133] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.118133] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.118133] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a10027e-1a93-40ca-a079-297eb6af7618" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.275768] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-860 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.276095] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-860" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.276095] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-860" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.276349] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-860" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.279388] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.279600] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.279734] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.279965] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.280129] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.280337] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 782.280453] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 782.280564] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 782.280679] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 782.280784] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 782.280890] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 782.281033] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 782.297802] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 782.297959] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 782.298117] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 782.298277] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-860" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.298558] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-5b6b00cf-55ae-4c3e-a499-95e58b106387 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.300027] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-5b6b00cf-55ae-4c3e-a499-95e58b106387" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.300027] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-5b6b00cf-55ae-4c3e-a499-95e58b106387" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.300027] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-5b6b00cf-55ae-4c3e-a499-95e58b106387" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.300027] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b6b00cf-55ae-4c3e-a499-95e58b106387',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.329992] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.330129] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.330235] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.330506] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.330652] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.332540] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port ce1440b0-008c-48c7-b1c8-61ab26650d98 not found, creating... [ 782.332540] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.332540] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.332540] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.332540] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.332540] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.332540] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.332540] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.332540] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.336108] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.336310] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.336457] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: ce1440b0-008c-48c7-b1c8-61ab26650d98 is going to be created. [ 782.356403] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.356748] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.356834] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.357110] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.357332] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.357552] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-ce1440b0-008c-48c7-b1c8-61ab26650d98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.425112] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: SUCCESS [ 782.425112] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.425112] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.425112] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.425112] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.425112] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.425112] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.426174] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.426408] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.426602] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.426792] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.429166] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.429350] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.429532] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.429653] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.429716] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.429865] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.429944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.430044] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.582347] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.802954] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.803207] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.803337] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.803618] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.803771] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.803927] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 5b6b00cf-55ae-4c3e-a499-95e58b106387 not found, creating... [ 782.804215] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.804371] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.804489] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.804708] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.804846] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.805147] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.805304] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.805422] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.805629] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.805765] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.805903] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 5b6b00cf-55ae-4c3e-a499-95e58b106387 is going to be created. [ 782.824444] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.825015] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.825015] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.825097] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.825599] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.825599] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-5b6b00cf-55ae-4c3e-a499-95e58b106387" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.931116] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.931265] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.931725] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.068448] env[70013]: INFO networking_nsxv3.common.synchronization [req-2caed8ec-591d-4579-9059-17e0c57192e8 req-e019a1ec-5b3a-4668-ac76-e9f8a867b7a7 service nova] Enqueued Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_rules [ 783.068448] env[70013]: INFO networking_nsxv3.common.synchronization [req-2caed8ec-591d-4579-9059-17e0c57192e8 req-e019a1ec-5b3a-4668-ac76-e9f8a867b7a7 service nova] Enqueued Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 783.068713] env[70013]: INFO networking_nsxv3.common.synchronization [req-2caed8ec-591d-4579-9059-17e0c57192e8 req-e019a1ec-5b3a-4668-ac76-e9f8a867b7a7 service nova] Enqueued Resource ID: ce1440b0-008c-48c7-b1c8-61ab26650d98 with Priority: HIGHEST for action port [ 783.068837] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_rules [ 783.068886] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 783.068983] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce1440b0-008c-48c7-b1c8-61ab26650d98 with Priority: HIGHEST for action port [ 783.069550] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.069752] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.069752] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.069944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.070078] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.070995] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.070995] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.071196] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce1440b0-008c-48c7-b1c8-61ab26650d98 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.071298] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce1440b0-008c-48c7-b1c8-61ab26650d98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.071830] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce1440b0-008c-48c7-b1c8-61ab26650d98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.071830] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce1440b0-008c-48c7-b1c8-61ab26650d98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.071830] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce1440b0-008c-48c7-b1c8-61ab26650d98',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.085259] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.085259] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.085259] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.085259] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.085259] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.085564] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d47d19df-e406-4c01-9cf0-1110c7c55440 is going to be created. [ 783.119414] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.119575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.119634] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.119843] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.120058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.130017] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: UNINITIALIZED for 2s [ 783.439581] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.573100] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.573248] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.577572] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce1440b0-008c-48c7-b1c8-61ab26650d98 with status ACTIVE [ 783.577798] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.577929] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.578062] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.578220] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.578322] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.578496] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.578634] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.578634] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.578824] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.578879] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.579056] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.579145] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.579200] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.579342] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.579411] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.579494] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce1440b0-008c-48c7-b1c8-61ab26650d98 is going to be updated. [ 783.598949] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.600329] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.600329] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.600329] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.600329] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.600329] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce1440b0-008c-48c7-b1c8-61ab26650d98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.844033] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: SUCCESS [ 783.844033] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b deletion is rescheduled due to dependency. [ 783.844033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.844033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.844033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.844033] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.844033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.844033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.844033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.844033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.844033] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.847414] env[70013]: INFO networking_nsxv3.common.synchronization [req-4edd1b86-297d-4398-b6d1-c4c494ea9bca req-95c1387a-9000-4a29-a224-fc7a8a9c5aa0 service nova] Enqueued Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_rules [ 783.847759] env[70013]: INFO networking_nsxv3.common.synchronization [req-4edd1b86-297d-4398-b6d1-c4c494ea9bca req-95c1387a-9000-4a29-a224-fc7a8a9c5aa0 service nova] Enqueued Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 783.849965] env[70013]: INFO networking_nsxv3.common.synchronization [req-4edd1b86-297d-4398-b6d1-c4c494ea9bca req-95c1387a-9000-4a29-a224-fc7a8a9c5aa0 service nova] Enqueued Resource ID: 5b6b00cf-55ae-4c3e-a499-95e58b106387 with Priority: HIGHEST for action port [ 783.849965] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_rules [ 783.849965] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 783.849965] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b6b00cf-55ae-4c3e-a499-95e58b106387 with Priority: HIGHEST for action port [ 783.849965] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.849965] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.850420] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.850420] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.850915] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b6b00cf-55ae-4c3e-a499-95e58b106387 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.850915] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b6b00cf-55ae-4c3e-a499-95e58b106387" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.850915] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b6b00cf-55ae-4c3e-a499-95e58b106387" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.850915] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b6b00cf-55ae-4c3e-a499-95e58b106387" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.851170] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b6b00cf-55ae-4c3e-a499-95e58b106387',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.943040] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.943040] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.943040] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.943040] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.943040] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.943040] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86efc288-b26f-4298-9444-58202b5c40d5 is going to be updated. [ 783.976586] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.976726] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.976801] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.977145] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.977300] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.986266] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: IN_PROGRESS for 2s [ 784.244369] env[70013]: INFO networking_nsxv3.common.synchronization [req-5d284dd7-6c4b-45bc-a444-f692cba1a8e1 req-99e59b6a-5010-4bab-9f83-d038333ba2a6 tempest-ServersAdminTestJSON-1183835690 tempest-ServersAdminTestJSON-1183835690-project-member] Enqueued Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_members [ 784.244369] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_members [ 784.244644] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7abade-e912-4196-b558-4a6d4ece9b29 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.244644] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.245671] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.245671] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.245671] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.245671] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.245671] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.246092] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.246130] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.246420] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.349587] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.355036] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b6b00cf-55ae-4c3e-a499-95e58b106387 with status ACTIVE [ 784.355289] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.355431] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.355503] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.355804] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.355875] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.356095] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.356193] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.356257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.356447] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.356859] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.356859] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.356859] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.356859] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.357381] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.357381] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.357381] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b6b00cf-55ae-4c3e-a499-95e58b106387 is going to be updated. [ 784.381666] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.382087] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.382192] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.382391] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.382534] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.382710] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b6b00cf-55ae-4c3e-a499-95e58b106387" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.748253] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.852691] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.979013] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-713 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.979171] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-713" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.979171] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-713" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.979436] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-713" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.979724] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.979888] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.980018] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.980245] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.980389] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.980604] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 784.980721] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 784.980831] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 784.980940] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 784.981080] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 784.981375] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 784.981469] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 785.002072] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 785.002900] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 785.002900] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 785.002900] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-713" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.003184] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-632c2a24-8d7d-4754-87e6-79e1f5f4b8bf taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.003301] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-632c2a24-8d7d-4754-87e6-79e1f5f4b8bf" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.003342] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-632c2a24-8d7d-4754-87e6-79e1f5f4b8bf" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.004645] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-632c2a24-8d7d-4754-87e6-79e1f5f4b8bf" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.004645] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('632c2a24-8d7d-4754-87e6-79e1f5f4b8bf',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.139136] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: UNINITIALIZED for 4s [ 785.254407] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.357661] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.357871] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.357917] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.359030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.359030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.359030] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b is going to be updated. [ 785.386300] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.386428] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.386465] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.386770] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.387066] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.401587] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: IN_PROGRESS for 2s [ 785.508688] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.508918] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.509063] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.509381] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.509577] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.509819] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 632c2a24-8d7d-4754-87e6-79e1f5f4b8bf not found, creating... [ 785.510144] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.510315] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.510438] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.510687] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.510887] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.511813] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.512044] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.512204] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.512496] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.512691] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.513098] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 632c2a24-8d7d-4754-87e6-79e1f5f4b8bf is going to be created. [ 785.535194] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.535194] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.535194] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.536607] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.536607] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.536952] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-632c2a24-8d7d-4754-87e6-79e1f5f4b8bf" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.759297] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.759741] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.759741] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.759741] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.759741] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.760048] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 is going to be updated. [ 785.790516] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.790712] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.790814] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.790989] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.791172] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.801908] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: IN_PROGRESS for 2s [ 785.996801] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: SUCCESS [ 785.997039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.997777] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.997777] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.997777] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.997777] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.997777] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.998090] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.998090] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.998090] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.998235] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.998311] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.998372] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.998535] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.999566] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.999566] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.999566] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.999566] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.999566] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.999566] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.999566] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.000104] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.000282] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.000432] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.000531] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.000595] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.000735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.000812] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.000917] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.245461] env[70013]: INFO networking_nsxv3.common.synchronization [req-5d284dd7-6c4b-45bc-a444-f692cba1a8e1 req-710441ca-165b-4c0f-840d-d9db73630500 service nova] Enqueued Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_rules [ 786.245461] env[70013]: INFO networking_nsxv3.common.synchronization [req-5d284dd7-6c4b-45bc-a444-f692cba1a8e1 req-710441ca-165b-4c0f-840d-d9db73630500 service nova] Enqueued Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_members [ 786.245461] env[70013]: INFO networking_nsxv3.common.synchronization [req-5d284dd7-6c4b-45bc-a444-f692cba1a8e1 req-710441ca-165b-4c0f-840d-d9db73630500 service nova] Enqueued Resource ID: 632c2a24-8d7d-4754-87e6-79e1f5f4b8bf with Priority: HIGHEST for action port [ 786.245461] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_rules [ 786.245461] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_members [ 786.245461] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 632c2a24-8d7d-4754-87e6-79e1f5f4b8bf with Priority: HIGHEST for action port [ 786.246576] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a7abade-e912-4196-b558-4a6d4ece9b29 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.246576] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.246576] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.246576] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.246576] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.248678] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7abade-e912-4196-b558-4a6d4ece9b29 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.248678] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.248678] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-632c2a24-8d7d-4754-87e6-79e1f5f4b8bf taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.248678] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-632c2a24-8d7d-4754-87e6-79e1f5f4b8bf" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.248678] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-632c2a24-8d7d-4754-87e6-79e1f5f4b8bf" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.248985] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-632c2a24-8d7d-4754-87e6-79e1f5f4b8bf" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.248985] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('632c2a24-8d7d-4754-87e6-79e1f5f4b8bf',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.504151] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.504970] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 86efc288-b26f-4298-9444-58202b5c40d5: rpc.has_security_group_logging(os_id): False [ 786.528894] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.528894] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.528894] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.528894] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.528894] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.529160] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.529160] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.529160] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.529278] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.529354] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.529522] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.529612] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.529672] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.529811] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.529880] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.530065] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.530153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.530209] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.530345] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.532285] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.532285] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86efc288-b26f-4298-9444-58202b5c40d5 is going to be created. [ 786.591633] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.592125] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.592267] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.592580] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.595718] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.613773] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: IN_PROGRESS for 2s [ 786.665422] env[70013]: INFO networking_nsxv3.common.synchronization [req-103b08c1-83fe-416e-9a36-9f32f9cf69cd req-debff883-6cd9-4da3-9822-efc860f50a51 tempest-ServerDiagnosticsTest-382342043 tempest-ServerDiagnosticsTest-382342043-project-member] Enqueued Resource ID: 12839468-1e74-4c74-abf4-73e096a46e61 with Priority: HIGHEST for action security_group_members [ 786.665422] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12839468-1e74-4c74-abf4-73e096a46e61 with Priority: HIGHEST for action security_group_members [ 786.665631] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-12839468-1e74-4c74-abf4-73e096a46e61 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.665704] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.665753] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.665923] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.666088] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.666188] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.666250] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.666399] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.666486] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.666575] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12839468-1e74-4c74-abf4-73e096a46e61',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.742606] env[70013]: INFO networking_nsxv3.common.synchronization [req-fd363767-d0e4-4e9d-909e-5725ae197596 req-750f11aa-e89a-429c-9c10-f88e3876c03d tempest-MultipleCreateTestJSON-634477930 tempest-MultipleCreateTestJSON-634477930-project-member] Enqueued Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_members [ 786.742708] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_members [ 786.743118] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.743226] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.743226] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.743460] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.743625] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.743750] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.743802] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.743911] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.743993] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.744452] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.751746] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 632c2a24-8d7d-4754-87e6-79e1f5f4b8bf with status ACTIVE [ 786.751832] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.751955] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.752136] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.752204] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.752296] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.752465] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.752701] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.752701] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.752810] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.752890] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.753114] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.753204] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.753244] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.753425] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.753481] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.753530] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 632c2a24-8d7d-4754-87e6-79e1f5f4b8bf is going to be updated. [ 786.754681] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7abade-e912-4196-b558-4a6d4ece9b29 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.754781] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.782951] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.783655] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.783747] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.783960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.784166] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.784334] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-632c2a24-8d7d-4754-87e6-79e1f5f4b8bf" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.009047] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.082601] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-269 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.082601] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-269" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.082601] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-269" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.082601] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-269" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.082601] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.082601] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.082601] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.082601] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.082971] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.082971] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 787.083069] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 787.083234] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 787.083378] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 787.083520] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 787.083681] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 787.083869] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 787.110099] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 787.110099] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 787.110099] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 787.110099] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-269" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.110099] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-181209a0-c7c5-4fb9-ba9a-7f87cc194836 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.110099] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-181209a0-c7c5-4fb9-ba9a-7f87cc194836" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.110099] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-181209a0-c7c5-4fb9-ba9a-7f87cc194836" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.110099] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-181209a0-c7c5-4fb9-ba9a-7f87cc194836" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.110099] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('181209a0-c7c5-4fb9-ba9a-7f87cc194836',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.150549] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: SUCCESS [ 787.150865] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.151373] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.151654] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.151875] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.151974] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.152047] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.152206] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.152288] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.152373] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.152461] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.168971] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.169170] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.169235] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.169517] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.169674] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.169838] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.169922] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.170077] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.170131] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.170250] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.170302] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12839468-1e74-4c74-abf4-73e096a46e61 is going to be updated. [ 787.194792] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.194929] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.194998] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.195224] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.195368] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.212224] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12839468-1e74-4c74-abf4-73e096a46e61 in Status: IN_PROGRESS for 2s [ 787.246558] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.246775] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.246775] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.246995] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.247108] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.247416] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.247416] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.247534] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.248730] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.248730] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.248730] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b already deleted. [ 787.248730] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.410869] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: SUCCESS [ 787.411148] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.411743] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.411858] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.412026] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.412138] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.412221] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.412401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.412493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.412629] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.412726] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.510339] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.510550] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.510644] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.510896] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.510999] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.511119] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86efc288-b26f-4298-9444-58202b5c40d5 is going to be updated. [ 787.545035] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.545035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.545226] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.545292] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.546036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.554197] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: IN_PROGRESS for 2s [ 787.617441] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.617705] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.617831] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.618130] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.618281] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.618436] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 181209a0-c7c5-4fb9-ba9a-7f87cc194836 not found, creating... [ 787.618701] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.618858] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.618974] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.619210] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.619347] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.619662] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.619836] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.619954] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.620181] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.620342] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.620449] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 181209a0-c7c5-4fb9-ba9a-7f87cc194836 is going to be created. [ 787.639713] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.640151] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.640424] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.640717] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.640951] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.641190] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-181209a0-c7c5-4fb9-ba9a-7f87cc194836" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.655038] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.655038] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.655275] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.655275] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.655444] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.655542] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.655608] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.655758] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.655846] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.655933] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.656085] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.656179] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.656240] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.656379] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.656514] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.656608] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.656662] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.656800] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.656875] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.656970] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.657074] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.817414] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: SUCCESS [ 787.817759] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.817846] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.818094] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.818269] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.818386] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.818454] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.818604] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.818689] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.818784] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.914951] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.915135] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.915196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.915453] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.915640] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.915731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.915854] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.916129] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.916129] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.916204] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.916327] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.916420] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.916499] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.916627] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.916767] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.916859] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.916917] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.917068] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.917147] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.917228] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.917317] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.161213] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d47d19df-e406-4c01-9cf0-1110c7c55440: rpc.has_security_group_logging(os_id): False [ 788.180707] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.181427] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.181427] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.181427] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.181427] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.181427] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.181781] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.181781] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.181781] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.181895] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.182099] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.182181] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.182228] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.182411] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.182497] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.182708] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.182807] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.182871] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.183120] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.183120] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.183217] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d47d19df-e406-4c01-9cf0-1110c7c55440 is going to be created. [ 788.273411] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.273519] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.273636] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.275099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.275099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.286791] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: IN_PROGRESS for 2s [ 788.320991] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.347259] env[70013]: INFO networking_nsxv3.common.synchronization [req-fd363767-d0e4-4e9d-909e-5725ae197596 req-3fb02cf6-91da-405a-a001-bb4ad1c070e6 service nova] Enqueued Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_rules [ 788.347259] env[70013]: INFO networking_nsxv3.common.synchronization [req-fd363767-d0e4-4e9d-909e-5725ae197596 req-3fb02cf6-91da-405a-a001-bb4ad1c070e6 service nova] Enqueued Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_members [ 788.347259] env[70013]: INFO networking_nsxv3.common.synchronization [req-fd363767-d0e4-4e9d-909e-5725ae197596 req-3fb02cf6-91da-405a-a001-bb4ad1c070e6 service nova] Enqueued Resource ID: 181209a0-c7c5-4fb9-ba9a-7f87cc194836 with Priority: HIGHEST for action port [ 788.347259] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_rules [ 788.347510] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_members [ 788.347510] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 181209a0-c7c5-4fb9-ba9a-7f87cc194836 with Priority: HIGHEST for action port [ 788.348398] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.348600] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.351238] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.351238] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.351238] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.351238] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.351238] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.351238] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.351238] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.351238] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.351238] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.351238] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.351238] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.351238] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.352351] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.352351] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-181209a0-c7c5-4fb9-ba9a-7f87cc194836 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.352514] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-181209a0-c7c5-4fb9-ba9a-7f87cc194836" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.352514] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-181209a0-c7c5-4fb9-ba9a-7f87cc194836" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.353167] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-181209a0-c7c5-4fb9-ba9a-7f87cc194836" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.353167] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('181209a0-c7c5-4fb9-ba9a-7f87cc194836',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.419656] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16c877e7-f731-49a5-b994-7d74c36c464b: rpc.has_security_group_logging(os_id): False [ 788.547028] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.547227] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.547227] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.547460] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.547550] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.547771] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.547869] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.547935] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.548111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.548190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.548372] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.548464] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.548526] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.548700] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.548784] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.548975] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.549090] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.549151] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.549292] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.549368] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.549453] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b is going to be updated. [ 788.646386] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: SUCCESS [ 788.646619] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.646794] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.647023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.647114] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.654735] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.654735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.654735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.654735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.654735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.678168] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: IN_PROGRESS for 2s [ 788.822964] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.854397] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.854537] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.854697] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.855682] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 181209a0-c7c5-4fb9-ba9a-7f87cc194836 with status ACTIVE [ 788.855793] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.855860] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.858896] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.858896] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.858896] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.858896] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.858896] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.858896] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.858896] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.858896] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.858896] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.858896] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.858896] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.858896] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.858896] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.858896] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 181209a0-c7c5-4fb9-ba9a-7f87cc194836 is going to be updated. [ 788.880190] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.880337] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.880407] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.880650] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.880848] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.880951] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-181209a0-c7c5-4fb9-ba9a-7f87cc194836" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.149829] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.150010] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.226159] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12839468-1e74-4c74-abf4-73e096a46e61 in Status: SUCCESS [ 789.226246] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12839468-1e74-4c74-abf4-73e096a46e61 deletion is rescheduled due to dependency. [ 789.226370] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.326061] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.326061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.326061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.326061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.326061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.326061] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 is going to be updated. [ 789.353348] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.353589] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.353589] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.353824] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.354016] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.359992] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.364737] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: IN_PROGRESS for 2s [ 789.567159] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: SUCCESS [ 789.567377] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.567607] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.567803] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.567994] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.568130] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.568208] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.568477] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.568577] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.568651] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.568744] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.862690] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.863026] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.863026] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.863160] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.863209] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.863310] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b is going to be created. [ 789.887456] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.887608] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.887691] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.887897] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.888089] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.896485] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: UNINITIALIZED for 2s [ 790.072471] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.073244] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.073398] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.073605] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.073796] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.073945] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.074019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.074159] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.074252] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.074341] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.074488] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.074583] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.074635] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.074780] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.074916] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.075015] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.075080] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.075218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.075292] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.075368] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.075457] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.299393] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: SUCCESS [ 790.299691] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.578091] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 86efc288-b26f-4298-9444-58202b5c40d5: rpc.has_security_group_logging(os_id): False [ 790.598797] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.598945] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.599019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.599243] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.599340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.599562] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.599667] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.599731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.599948] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.599948] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.600142] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.600236] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.600298] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.600437] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.600511] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.600688] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.600779] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.600840] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.600976] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.601079] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.601168] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86efc288-b26f-4298-9444-58202b5c40d5 is going to be updated. [ 790.656477] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.656857] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.656857] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.657279] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.657605] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.669964] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: IN_PROGRESS for 2s [ 790.688974] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: SUCCESS [ 790.689229] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.779417] env[70013]: INFO networking_nsxv3.common.synchronization [req-4a1222d5-4500-4f25-9588-18e5687a5db2 req-4cf7bcfa-7740-4452-bdb3-2d737311cc2a tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: 35104466-92f1-4e6a-9df0-55e3f828079c with Priority: HIGHEST for action security_group_members [ 790.779614] env[70013]: INFO networking_nsxv3.common.synchronization [req-4a1222d5-4500-4f25-9588-18e5687a5db2 req-4cf7bcfa-7740-4452-bdb3-2d737311cc2a tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_members [ 790.780270] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35104466-92f1-4e6a-9df0-55e3f828079c with Priority: HIGHEST for action security_group_members [ 790.780415] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_members [ 790.780926] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-35104466-92f1-4e6a-9df0-55e3f828079c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.781084] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.781162] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.781423] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.781603] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.781972] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.781972] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.781972] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.782127] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.782127] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35104466-92f1-4e6a-9df0-55e3f828079c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.782931] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.783044] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.783115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.783272] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.783408] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.783497] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.783558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.783695] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.783772] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.783856] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.095470] env[70013]: INFO networking_nsxv3.common.synchronization [req-4a1222d5-4500-4f25-9588-18e5687a5db2 req-4cf7bcfa-7740-4452-bdb3-2d737311cc2a tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: 35104466-92f1-4e6a-9df0-55e3f828079c with Priority: HIGHEST for action security_group_rules [ 791.095470] env[70013]: INFO networking_nsxv3.common.synchronization [req-4a1222d5-4500-4f25-9588-18e5687a5db2 req-4cf7bcfa-7740-4452-bdb3-2d737311cc2a tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: 35104466-92f1-4e6a-9df0-55e3f828079c with Priority: HIGHEST for action security_group_members [ 791.095470] env[70013]: INFO networking_nsxv3.common.synchronization [req-4a1222d5-4500-4f25-9588-18e5687a5db2 req-4cf7bcfa-7740-4452-bdb3-2d737311cc2a tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_rules [ 791.095470] env[70013]: INFO networking_nsxv3.common.synchronization [req-4a1222d5-4500-4f25-9588-18e5687a5db2 req-4cf7bcfa-7740-4452-bdb3-2d737311cc2a tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_members [ 791.095470] env[70013]: INFO networking_nsxv3.common.synchronization [req-4a1222d5-4500-4f25-9588-18e5687a5db2 req-4cf7bcfa-7740-4452-bdb3-2d737311cc2a tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: 2a10027e-1a93-40ca-a079-297eb6af7618 with Priority: HIGHEST for action port [ 791.095470] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35104466-92f1-4e6a-9df0-55e3f828079c with Priority: HIGHEST for action security_group_rules [ 791.095470] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_rules [ 791.095470] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a10027e-1a93-40ca-a079-297eb6af7618 with Priority: HIGHEST for action port [ 791.095470] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35104466-92f1-4e6a-9df0-55e3f828079c with Priority: HIGHEST for action security_group_members [ 791.095470] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_members [ 791.095470] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35104466-92f1-4e6a-9df0-55e3f828079c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.095470] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.095470] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.095470] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.095470] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35104466-92f1-4e6a-9df0-55e3f828079c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.096142] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.096142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.096142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.096142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.096330] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.097969] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a10027e-1a93-40ca-a079-297eb6af7618 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.097969] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a10027e-1a93-40ca-a079-297eb6af7618" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.097969] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a10027e-1a93-40ca-a079-297eb6af7618" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.097969] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a10027e-1a93-40ca-a079-297eb6af7618" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.097969] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a10027e-1a93-40ca-a079-297eb6af7618',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.098368] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-35104466-92f1-4e6a-9df0-55e3f828079c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.098459] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.098653] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.098738] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.122796] env[70013]: INFO networking_nsxv3.common.synchronization [req-fd363767-d0e4-4e9d-909e-5725ae197596 req-e41e8713-4f43-4afb-8a7c-74fb583da3ad tempest-MultipleCreateTestJSON-634477930 tempest-MultipleCreateTestJSON-634477930-project-member] Enqueued Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_members [ 791.122796] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_members [ 791.122796] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.122796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.289152] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('35104466-92f1-4e6a-9df0-55e3f828079c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.291998] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.374737] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: SUCCESS [ 791.374847] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.375023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.375240] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.375436] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.375562] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.375617] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.375774] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.375857] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.375942] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.376046] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.554830] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-269 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.555018] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-269" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.555155] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-269" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.555442] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-269" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.556346] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.556346] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.556346] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.556346] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.556346] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.556642] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 791.556684] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 791.557977] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 791.557977] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 791.557977] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 791.557977] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 791.557977] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 791.587751] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 791.587953] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 791.591020] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 791.591020] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-269" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.591020] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-dfb75973-77e7-42e3-96d1-4b8f24a37d6d taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.591020] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-dfb75973-77e7-42e3-96d1-4b8f24a37d6d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.591020] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-dfb75973-77e7-42e3-96d1-4b8f24a37d6d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.591020] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-dfb75973-77e7-42e3-96d1-4b8f24a37d6d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.591020] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfb75973-77e7-42e3-96d1-4b8f24a37d6d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.601133] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.601309] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.601604] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a10027e-1a93-40ca-a079-297eb6af7618 with status ACTIVE [ 791.601898] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.601954] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.602086] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.602290] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.602383] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.602549] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.602671] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.603115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.603115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.603115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.603253] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.603253] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.603338] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.603447] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.603559] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.603593] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a10027e-1a93-40ca-a079-297eb6af7618 is going to be updated. [ 791.604694] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-35104466-92f1-4e6a-9df0-55e3f828079c taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.604796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.643509] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.643657] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.643734] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.643958] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.644124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.644279] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a10027e-1a93-40ca-a079-297eb6af7618" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.794906] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('35104466-92f1-4e6a-9df0-55e3f828079c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.795994] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.860138] env[70013]: INFO networking_nsxv3.common.synchronization [req-835c926b-bff1-4b7a-8230-57fdaf495a9f req-28c28a20-a37f-4eb7-9b63-00b16fec1a46 tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 with Priority: HIGHEST for action security_group_members [ 791.860138] env[70013]: INFO networking_nsxv3.common.synchronization [req-835c926b-bff1-4b7a-8230-57fdaf495a9f req-28c28a20-a37f-4eb7-9b63-00b16fec1a46 tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: 35104466-92f1-4e6a-9df0-55e3f828079c with Priority: HIGHEST for action security_group_members [ 791.860138] env[70013]: INFO networking_nsxv3.common.synchronization [req-835c926b-bff1-4b7a-8230-57fdaf495a9f req-28c28a20-a37f-4eb7-9b63-00b16fec1a46 tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_members [ 791.860308] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 with Priority: HIGHEST for action security_group_members [ 791.860693] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35104466-92f1-4e6a-9df0-55e3f828079c with Priority: HIGHEST for action security_group_members [ 791.860829] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_members [ 791.861503] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1197cb6b-f6f8-4e0a-8b93-e11877f2e915 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.861886] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.862034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.862512] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.862749] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.862934] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.863064] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.865236] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.865236] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.865236] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1197cb6b-f6f8-4e0a-8b93-e11877f2e915',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.865236] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-35104466-92f1-4e6a-9df0-55e3f828079c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.865236] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.865236] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.865236] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.878947] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7abade-e912-4196-b558-4a6d4ece9b29 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.878947] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.878947] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.879196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.879311] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.879425] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.879535] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.879786] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.879907] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.880052] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.880248] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7abade-e912-4196-b558-4a6d4ece9b29 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.880375] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.880457] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.880649] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.880878] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.881027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.881181] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.881286] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.881384] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.881469] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.881618] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.906217] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: SUCCESS [ 791.906515] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.906689] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.906967] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.907182] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.907300] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.907389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.907540] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.907646] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.907733] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.907824] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.908669] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.908992] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.908992] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.909197] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.909260] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.909708] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.909708] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.909708] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.938583] env[70013]: INFO networking_nsxv3.common.synchronization [req-835c926b-bff1-4b7a-8230-57fdaf495a9f req-28c28a20-a37f-4eb7-9b63-00b16fec1a46 tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 with Priority: HIGHEST for action security_group_rules [ 791.938801] env[70013]: INFO networking_nsxv3.common.synchronization [req-835c926b-bff1-4b7a-8230-57fdaf495a9f req-28c28a20-a37f-4eb7-9b63-00b16fec1a46 tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 with Priority: HIGHEST for action security_group_members [ 791.938963] env[70013]: INFO networking_nsxv3.common.synchronization [req-835c926b-bff1-4b7a-8230-57fdaf495a9f req-28c28a20-a37f-4eb7-9b63-00b16fec1a46 tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: 35104466-92f1-4e6a-9df0-55e3f828079c with Priority: HIGHEST for action security_group_rules [ 791.939120] env[70013]: INFO networking_nsxv3.common.synchronization [req-835c926b-bff1-4b7a-8230-57fdaf495a9f req-28c28a20-a37f-4eb7-9b63-00b16fec1a46 tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: 35104466-92f1-4e6a-9df0-55e3f828079c with Priority: HIGHEST for action security_group_members [ 791.939252] env[70013]: INFO networking_nsxv3.common.synchronization [req-835c926b-bff1-4b7a-8230-57fdaf495a9f req-28c28a20-a37f-4eb7-9b63-00b16fec1a46 tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_rules [ 791.939403] env[70013]: INFO networking_nsxv3.common.synchronization [req-835c926b-bff1-4b7a-8230-57fdaf495a9f req-28c28a20-a37f-4eb7-9b63-00b16fec1a46 tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_members [ 791.939655] env[70013]: INFO networking_nsxv3.common.synchronization [req-835c926b-bff1-4b7a-8230-57fdaf495a9f req-28c28a20-a37f-4eb7-9b63-00b16fec1a46 tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: 2a10027e-1a93-40ca-a079-297eb6af7618 with Priority: HIGHEST for action port [ 791.940409] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 with Priority: HIGHEST for action security_group_rules [ 791.940624] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35104466-92f1-4e6a-9df0-55e3f828079c with Priority: HIGHEST for action security_group_rules [ 791.940818] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_members [ 791.941135] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a10027e-1a93-40ca-a079-297eb6af7618 with Priority: HIGHEST for action port [ 791.941179] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_rules [ 791.941307] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 with Priority: HIGHEST for action security_group_members [ 791.941437] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35104466-92f1-4e6a-9df0-55e3f828079c with Priority: HIGHEST for action security_group_members [ 791.941776] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1197cb6b-f6f8-4e0a-8b93-e11877f2e915 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.941929] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.942033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.942443] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.942526] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1197cb6b-f6f8-4e0a-8b93-e11877f2e915',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.943596] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35104466-92f1-4e6a-9df0-55e3f828079c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.943728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.944032] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.944144] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.944444] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a10027e-1a93-40ca-a079-297eb6af7618 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.944525] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a10027e-1a93-40ca-a079-297eb6af7618" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.944632] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a10027e-1a93-40ca-a079-297eb6af7618" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.944855] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a10027e-1a93-40ca-a079-297eb6af7618" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.944948] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a10027e-1a93-40ca-a079-297eb6af7618',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.945978] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.945978] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.947026] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1197cb6b-f6f8-4e0a-8b93-e11877f2e915 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.947026] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.947026] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-35104466-92f1-4e6a-9df0-55e3f828079c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.947464] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.093691] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.094175] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.094330] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.094652] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.094850] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.095061] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port dfb75973-77e7-42e3-96d1-4b8f24a37d6d not found, creating... [ 792.096066] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.096066] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.096066] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.096066] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.096616] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.096896] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.097111] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.097721] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.097721] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.097721] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.097867] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: dfb75973-77e7-42e3-96d1-4b8f24a37d6d is going to be created. [ 792.116327] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.117049] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.117049] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.117049] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.117239] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.117494] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-dfb75973-77e7-42e3-96d1-4b8f24a37d6d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.301030] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.301030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.301030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.301030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.301030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.301030] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35104466-92f1-4e6a-9df0-55e3f828079c is going to be created. [ 792.301030] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.301030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.301030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.301030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.301030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.301030] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d47d19df-e406-4c01-9cf0-1110c7c55440 is going to be updated. [ 792.326235] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.326544] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.326696] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.327016] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.327288] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.335012] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.335441] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.335630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.335956] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.336264] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.338120] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35104466-92f1-4e6a-9df0-55e3f828079c in Status: UNINITIALIZED for 2s [ 792.344567] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: IN_PROGRESS for 2s [ 792.368619] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1197cb6b-f6f8-4e0a-8b93-e11877f2e915',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.386905] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a7abade-e912-4196-b558-4a6d4ece9b29: rpc.has_security_group_logging(os_id): False [ 792.405646] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.405857] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.405965] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.406488] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.406640] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.406967] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.407128] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.407229] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.407534] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.407574] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.407841] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.407985] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.408098] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.408316] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.408437] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.408800] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.408936] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.408936] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.409160] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.409273] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.409409] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 is going to be updated. [ 792.411642] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.411774] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.415085] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.449031] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1197cb6b-f6f8-4e0a-8b93-e11877f2e915 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.449161] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.449747] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a10027e-1a93-40ca-a079-297eb6af7618 with status ACTIVE [ 792.449747] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.449747] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.449934] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.450151] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.450258] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.450451] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.450553] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.450665] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.450788] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.450873] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.451155] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.451280] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.451280] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.451420] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.451458] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.451640] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a10027e-1a93-40ca-a079-297eb6af7618 is going to be updated. [ 792.474397] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.474397] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.474397] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.474633] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.474633] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.474759] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a10027e-1a93-40ca-a079-297eb6af7618" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.475743] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.475865] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.475936] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.478049] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.478049] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.491457] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: IN_PROGRESS for 2s [ 792.682685] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: SUCCESS [ 792.682995] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.683161] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.683405] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.683486] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.868065] env[70013]: INFO networking_nsxv3.common.synchronization [req-fd363767-d0e4-4e9d-909e-5725ae197596 req-5990ce75-f00f-4a05-bcc1-79b2f22b8d4a service nova] Enqueued Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_rules [ 792.868065] env[70013]: INFO networking_nsxv3.common.synchronization [req-fd363767-d0e4-4e9d-909e-5725ae197596 req-5990ce75-f00f-4a05-bcc1-79b2f22b8d4a service nova] Enqueued Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_members [ 792.868065] env[70013]: INFO networking_nsxv3.common.synchronization [req-fd363767-d0e4-4e9d-909e-5725ae197596 req-5990ce75-f00f-4a05-bcc1-79b2f22b8d4a service nova] Enqueued Resource ID: dfb75973-77e7-42e3-96d1-4b8f24a37d6d with Priority: HIGHEST for action port [ 792.868065] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_rules [ 792.868065] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_members [ 792.868065] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfb75973-77e7-42e3-96d1-4b8f24a37d6d with Priority: HIGHEST for action port [ 792.868065] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.871234] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.871362] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.871472] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.871726] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfb75973-77e7-42e3-96d1-4b8f24a37d6d taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.871852] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfb75973-77e7-42e3-96d1-4b8f24a37d6d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.871910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfb75973-77e7-42e3-96d1-4b8f24a37d6d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.872211] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfb75973-77e7-42e3-96d1-4b8f24a37d6d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.872211] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfb75973-77e7-42e3-96d1-4b8f24a37d6d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.874750] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1197cb6b-f6f8-4e0a-8b93-e11877f2e915',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.917775] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.186862] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.187165] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.187165] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.188021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.188021] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.188021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.188021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.188021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.188021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.188021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.188330] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.375039] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dfb75973-77e7-42e3-96d1-4b8f24a37d6d with status ACTIVE [ 793.375232] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.375418] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.375507] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.375802] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.375942] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.376291] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.376430] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.376520] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.376742] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.376852] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.377146] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.377725] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.377725] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.377725] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.377725] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.377725] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dfb75973-77e7-42e3-96d1-4b8f24a37d6d is going to be updated. [ 793.379358] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.379502] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.379597] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.379805] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.379914] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.380047] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 is going to be created. [ 793.405670] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.405848] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.405848] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.407035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.407035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.407035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfb75973-77e7-42e3-96d1-4b8f24a37d6d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.407786] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.408212] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.408212] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.408212] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.409276] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.418356] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 in Status: UNINITIALIZED for 2s [ 793.419899] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.420057] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.420135] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.420369] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.420478] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.420595] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b is going to be updated. [ 793.451148] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.451495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.451495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.451719] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.452059] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.463070] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: IN_PROGRESS for 2s [ 793.691510] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.691790] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.691893] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.692137] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.692378] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.692494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.692638] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.692823] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.692989] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.693115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.693304] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.693395] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.693513] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.693619] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.693776] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.693907] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.693957] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.694068] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.694203] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.694257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.694325] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.985520] env[70013]: INFO networking_nsxv3.common.synchronization [req-69b7ac10-235a-4d4d-86bb-f5d33f225b18 req-cac87695-0138-4b4e-a8a2-e85648f20313 tempest-ServersNegativeTestJSON-128962351 tempest-ServersNegativeTestJSON-128962351-project-member] Enqueued Resource ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 with Priority: HIGHEST for action security_group_members [ 793.986061] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 with Priority: HIGHEST for action security_group_members [ 793.986356] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b51e70d-5edb-4332-99e9-eb53e6015365 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.986476] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.986541] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.986796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.987490] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.987722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.987795] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.988034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.988200] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.988399] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.196955] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 86efc288-b26f-4298-9444-58202b5c40d5: rpc.has_security_group_logging(os_id): False [ 794.217292] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.217292] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.217292] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.217292] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.217292] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.217292] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.217292] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.217292] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.217292] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.217292] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.218775] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.219621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.219621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.219730] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.220473] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.221029] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.221355] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.221499] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.221685] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.221754] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.221864] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86efc288-b26f-4298-9444-58202b5c40d5 is going to be updated. [ 794.299303] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.299466] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.299817] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.300086] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.300254] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.312812] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: IN_PROGRESS for 2s [ 794.349877] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35104466-92f1-4e6a-9df0-55e3f828079c in Status: SUCCESS [ 794.352531] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.352531] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.353453] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.353453] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.355358] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.355358] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.355358] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.355358] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.355358] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35104466-92f1-4e6a-9df0-55e3f828079c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.367706] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: SUCCESS [ 794.367825] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.367953] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.368188] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.368372] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.368486] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.368552] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.368696] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.368807] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.368867] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.441888] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-35 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.442101] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-35" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.442229] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-35" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.442548] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-35" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.442811] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.443036] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.445015] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.445316] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.445478] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.445696] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 794.445815] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 794.445930] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 794.446058] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 794.446175] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 794.446285] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 794.446421] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 794.466104] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 794.466104] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 794.466104] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 794.466104] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-35" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.466104] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-52cf3b73-bbee-4e96-91f2-a1caa2041501 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.466104] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-52cf3b73-bbee-4e96-91f2-a1caa2041501" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.466104] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-52cf3b73-bbee-4e96-91f2-a1caa2041501" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.466104] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-52cf3b73-bbee-4e96-91f2-a1caa2041501" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.466104] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52cf3b73-bbee-4e96-91f2-a1caa2041501',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.493831] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.493831] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.493831] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.493831] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.493831] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.493831] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.493831] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.493831] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.493831] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.493831] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.493831] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 already deleted. [ 794.493831] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.505208] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: SUCCESS [ 794.505208] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.859907] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('35104466-92f1-4e6a-9df0-55e3f828079c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.870439] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.968823] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.969147] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.969372] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.970299] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.970609] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.970840] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 52cf3b73-bbee-4e96-91f2-a1caa2041501 not found, creating... [ 794.971237] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.971457] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.971698] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.972036] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.972200] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.972510] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.972737] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.972869] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.973126] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.973252] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.973395] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 52cf3b73-bbee-4e96-91f2-a1caa2041501 is going to be created. [ 794.993958] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.994144] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.995077] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.995077] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.995237] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.995446] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-52cf3b73-bbee-4e96-91f2-a1caa2041501" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.361479] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('35104466-92f1-4e6a-9df0-55e3f828079c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.373556] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.428721] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 in Status: SUCCESS [ 795.428950] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.429133] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.429352] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.429535] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.429661] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.429731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.429885] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.429969] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.430174] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1197cb6b-f6f8-4e0a-8b93-e11877f2e915',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.470183] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: SUCCESS [ 795.470413] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.470594] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.470850] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.471064] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.471187] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.471252] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.471404] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.471491] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.471584] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.471827] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.471944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.472030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.472185] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.472327] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.472422] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.472482] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.472620] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.472697] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.472782] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.472880] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.474236] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.474404] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.474552] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.474653] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.474713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.474874] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.474988] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.475055] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.623933] env[70013]: INFO networking_nsxv3.common.synchronization [req-1ef4b391-5fed-4275-80cb-ac68c9126c66 req-5af8c7e3-2f18-412e-8dfb-20e1141f9b8a tempest-ServersTestJSON-2095302437 tempest-ServersTestJSON-2095302437-project-member] Enqueued Resource ID: d1b8da2b-4abc-407f-9635-008e18b53627 with Priority: HIGHEST for action security_group_members [ 795.624443] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1b8da2b-4abc-407f-9635-008e18b53627 with Priority: HIGHEST for action security_group_members [ 795.624882] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1b8da2b-4abc-407f-9635-008e18b53627 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.624882] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.625474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.625474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.625474] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.625474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.625474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.625965] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.625965] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.625965] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1b8da2b-4abc-407f-9635-008e18b53627',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.867476] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.867476] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.867476] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.867476] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.867476] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.867476] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35104466-92f1-4e6a-9df0-55e3f828079c is going to be updated. [ 795.873849] env[70013]: INFO networking_nsxv3.common.synchronization [req-69b7ac10-235a-4d4d-86bb-f5d33f225b18 req-e144c48a-ddad-4cc6-bb8c-7810bc55c9f3 service nova] Enqueued Resource ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 with Priority: HIGHEST for action security_group_rules [ 795.874080] env[70013]: INFO networking_nsxv3.common.synchronization [req-69b7ac10-235a-4d4d-86bb-f5d33f225b18 req-e144c48a-ddad-4cc6-bb8c-7810bc55c9f3 service nova] Enqueued Resource ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 with Priority: HIGHEST for action security_group_members [ 795.874246] env[70013]: INFO networking_nsxv3.common.synchronization [req-69b7ac10-235a-4d4d-86bb-f5d33f225b18 req-e144c48a-ddad-4cc6-bb8c-7810bc55c9f3 service nova] Enqueued Resource ID: 52cf3b73-bbee-4e96-91f2-a1caa2041501 with Priority: HIGHEST for action port [ 795.874760] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 with Priority: HIGHEST for action security_group_rules [ 795.874888] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 with Priority: HIGHEST for action security_group_members [ 795.874982] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52cf3b73-bbee-4e96-91f2-a1caa2041501 with Priority: HIGHEST for action port [ 795.876282] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.876409] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.876466] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.876778] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.876869] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.877077] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d47d19df-e406-4c01-9cf0-1110c7c55440 is going to be updated. [ 795.879626] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b51e70d-5edb-4332-99e9-eb53e6015365 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.879741] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.879804] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.880080] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.880167] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.880961] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b51e70d-5edb-4332-99e9-eb53e6015365 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.881070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.882542] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.882542] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.882542] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.882542] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.882542] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.882542] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.882542] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.882848] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.883545] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-52cf3b73-bbee-4e96-91f2-a1caa2041501 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.883669] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52cf3b73-bbee-4e96-91f2-a1caa2041501" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.883711] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52cf3b73-bbee-4e96-91f2-a1caa2041501" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.883850] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52cf3b73-bbee-4e96-91f2-a1caa2041501" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.883921] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52cf3b73-bbee-4e96-91f2-a1caa2041501',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.894626] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.894626] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.894736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.894944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.895016] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.901953] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35104466-92f1-4e6a-9df0-55e3f828079c in Status: IN_PROGRESS for 2s [ 795.909764] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.909764] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.909875] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.910033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.910323] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.917996] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: IN_PROGRESS for 2s [ 795.932756] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1197cb6b-f6f8-4e0a-8b93-e11877f2e915',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.977631] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c2da01b-6452-4ea7-a1ca-fac9de38da7b: rpc.has_security_group_logging(os_id): False [ 795.980027] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.999730] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.999926] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.000047] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.000363] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.000515] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.001014] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.001014] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.001162] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.001274] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.001401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.001670] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.001834] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.001899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.002159] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.002267] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.002558] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.002682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.002778] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.002997] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.003312] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.003312] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b is going to be created. [ 796.074023] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.074023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.074023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.074023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.074023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.084832] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: IN_PROGRESS for 2s [ 796.131498] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.131786] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.131935] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.132308] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.132563] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.133078] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.133688] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.133688] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.134173] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.134173] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.135099] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1b8da2b-4abc-407f-9635-008e18b53627 is going to be updated. [ 796.191916] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.191916] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.191916] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.191916] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.191916] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.206391] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1b8da2b-4abc-407f-9635-008e18b53627 in Status: IN_PROGRESS for 2s [ 796.212095] env[70013]: INFO networking_nsxv3.common.synchronization [req-895ed8e8-53ea-4732-9f9c-013a1d5d7bc7 req-2eb5ff66-604b-4dc4-b0fb-07adfdac5390 tempest-ServersTestMultiNic-1935476789 tempest-ServersTestMultiNic-1935476789-project-member] Enqueued Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 796.212490] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 796.213014] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.213243] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.213371] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.213672] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.213903] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.214022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.214085] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.214261] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.214342] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.214437] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.330999] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: SUCCESS [ 796.330999] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.385943] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.389173] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b51e70d-5edb-4332-99e9-eb53e6015365 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.389173] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.389173] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52cf3b73-bbee-4e96-91f2-a1caa2041501 with status ACTIVE [ 796.389173] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.389173] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.389173] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.389868] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.389868] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.389868] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.389868] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.389868] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.392313] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.392433] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.392699] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.392841] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.392912] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.393611] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.393611] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.393611] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52cf3b73-bbee-4e96-91f2-a1caa2041501 is going to be updated. [ 796.414543] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.414691] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.414762] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.418029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.418029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.418029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52cf3b73-bbee-4e96-91f2-a1caa2041501" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.435427] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1197cb6b-f6f8-4e0a-8b93-e11877f2e915',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.482621] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.577030] env[70013]: INFO networking_nsxv3.common.synchronization [req-895ed8e8-53ea-4732-9f9c-013a1d5d7bc7 req-25140a17-102a-4e1f-9842-be48d1593832 tempest-ServersTestMultiNic-1935476789 tempest-ServersTestMultiNic-1935476789-project-member] Enqueued Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 796.578228] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 796.578447] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.578596] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.718210] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.897415] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.937722] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.937986] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.938077] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.938321] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.938430] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.938533] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 is going to be updated. [ 796.973725] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.973926] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.974061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.974338] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.974493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.983132] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 in Status: IN_PROGRESS for 2s [ 796.990143] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.990143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.990143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.990143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.990143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.990143] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b is going to be updated. [ 797.004423] env[70013]: INFO networking_nsxv3.common.synchronization [req-895ed8e8-53ea-4732-9f9c-013a1d5d7bc7 req-23ee175a-b4b5-45c2-8913-3985ad890cf2 tempest-ServersTestMultiNic-1935476789 tempest-ServersTestMultiNic-1935476789-project-member] Enqueued Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 797.004423] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 797.004423] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.004423] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.016384] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.016384] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.016384] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.016384] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.016384] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.023115] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: IN_PROGRESS for 2s [ 797.221011] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.401600] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.401922] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.401922] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.402167] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.402246] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.402804] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 is going to be created. [ 797.428401] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.428401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.428401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.428401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.428401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.437549] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 in Status: UNINITIALIZED for 2s [ 797.520525] env[70013]: INFO networking_nsxv3.common.synchronization [req-37f333a4-cd06-4d8b-9f11-3be862d50a45 req-cd6ce6de-f9fb-4e78-bddc-1005fbd055d0 tempest-ServerGroupTestJSON-297588656 tempest-ServerGroupTestJSON-297588656-project-member] Enqueued Resource ID: d78f0fb5-49a9-40c7-ad7a-277209d3d53c with Priority: HIGHEST for action security_group_members [ 797.521950] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d78f0fb5-49a9-40c7-ad7a-277209d3d53c with Priority: HIGHEST for action security_group_members [ 797.521950] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.521950] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.521950] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.521950] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.522257] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.522257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.522374] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.522508] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.524090] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.524090] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d78f0fb5-49a9-40c7-ad7a-277209d3d53c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.724409] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.724409] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.724409] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.724638] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.724638] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.724762] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86efc288-b26f-4298-9444-58202b5c40d5 is going to be updated. [ 797.753092] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.753289] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.753354] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.753619] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.753707] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.763987] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: IN_PROGRESS for 2s [ 797.848525] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-686 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.849672] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-686" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.849672] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-686" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.849672] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-686" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.849876] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.849945] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.850064] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.850332] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.850527] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.850800] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 797.850935] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 797.851071] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 797.851206] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 797.851346] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 797.851480] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 797.851641] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 797.868774] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 797.868774] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 797.868774] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 797.868913] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-686" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.871089] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-d57e8cdf-1b06-49d3-ba61-715ba529bb2e taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.871089] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-d57e8cdf-1b06-49d3-ba61-715ba529bb2e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.871089] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-d57e8cdf-1b06-49d3-ba61-715ba529bb2e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.871089] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-d57e8cdf-1b06-49d3-ba61-715ba529bb2e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.871089] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d57e8cdf-1b06-49d3-ba61-715ba529bb2e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.911824] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35104466-92f1-4e6a-9df0-55e3f828079c in Status: SUCCESS [ 797.911824] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.911824] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.911824] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.911824] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.911824] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.911824] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.911824] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.911824] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.911824] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.912229] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('35104466-92f1-4e6a-9df0-55e3f828079c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.912661] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.913558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.913558] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.913558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.913558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.913558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.913558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.913558] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35104466-92f1-4e6a-9df0-55e3f828079c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.926073] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: SUCCESS [ 797.926175] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.926319] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.926663] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.926745] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.926886] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.927008] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.927202] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.927315] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.927427] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.927549] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.928915] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.930165] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.930373] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.930487] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.930555] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.930856] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.930960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.931414] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.026799] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.027556] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.027686] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.027931] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.028163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.030788] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.030788] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.030788] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.030788] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.030788] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.030788] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d78f0fb5-49a9-40c7-ad7a-277209d3d53c already deleted. [ 798.030788] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.104021] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: SUCCESS [ 798.104021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.104021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.104021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.104021] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.217455] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1b8da2b-4abc-407f-9635-008e18b53627 in Status: SUCCESS [ 798.217649] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1b8da2b-4abc-407f-9635-008e18b53627 deletion is rescheduled due to dependency. [ 798.217766] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.373256] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.373473] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.373600] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.373881] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.374121] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.374251] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port d57e8cdf-1b06-49d3-ba61-715ba529bb2e not found, creating... [ 798.374510] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.374671] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.374813] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.375054] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.375198] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.375483] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.375632] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.375746] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.375952] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.376998] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.377143] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: d57e8cdf-1b06-49d3-ba61-715ba529bb2e is going to be created. [ 798.395313] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.395518] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.395645] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.395919] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.396166] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.396401] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-d57e8cdf-1b06-49d3-ba61-715ba529bb2e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.414976] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('35104466-92f1-4e6a-9df0-55e3f828079c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.419921] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('35104466-92f1-4e6a-9df0-55e3f828079c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.433522] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.433912] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.437270] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.605796] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.605959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.917565] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 35104466-92f1-4e6a-9df0-55e3f828079c: rpc.has_security_group_logging(os_id): False [ 798.928877] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('35104466-92f1-4e6a-9df0-55e3f828079c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.935819] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.935819] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.935819] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.935819] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.935819] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.936204] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.936295] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.936396] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.936569] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.940100] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.940100] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35104466-92f1-4e6a-9df0-55e3f828079c is going to be created. [ 798.940709] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.989597] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.989761] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.991839] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.991839] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.991839] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.000525] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 in Status: SUCCESS [ 799.000764] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.000930] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.001163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.001360] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.001480] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.001547] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.001795] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.001882] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.002016] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.002076] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1197cb6b-f6f8-4e0a-8b93-e11877f2e915',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.003836] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35104466-92f1-4e6a-9df0-55e3f828079c in Status: IN_PROGRESS for 2s [ 799.034654] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: SUCCESS [ 799.034654] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.034808] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.034984] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.035277] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.035430] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.035520] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.035765] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.035888] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.036008] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.036134] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.134101] env[70013]: INFO networking_nsxv3.common.synchronization [req-37f333a4-cd06-4d8b-9f11-3be862d50a45 req-c0db2496-5c3c-451d-87fb-4d91877123b5 service nova] Enqueued Resource ID: d78f0fb5-49a9-40c7-ad7a-277209d3d53c with Priority: HIGHEST for action security_group_rules [ 799.134101] env[70013]: INFO networking_nsxv3.common.synchronization [req-37f333a4-cd06-4d8b-9f11-3be862d50a45 req-c0db2496-5c3c-451d-87fb-4d91877123b5 service nova] Enqueued Resource ID: d78f0fb5-49a9-40c7-ad7a-277209d3d53c with Priority: HIGHEST for action security_group_members [ 799.134101] env[70013]: INFO networking_nsxv3.common.synchronization [req-37f333a4-cd06-4d8b-9f11-3be862d50a45 req-c0db2496-5c3c-451d-87fb-4d91877123b5 service nova] Enqueued Resource ID: d57e8cdf-1b06-49d3-ba61-715ba529bb2e with Priority: HIGHEST for action port [ 799.134662] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d78f0fb5-49a9-40c7-ad7a-277209d3d53c with Priority: HIGHEST for action security_group_rules [ 799.134662] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d78f0fb5-49a9-40c7-ad7a-277209d3d53c with Priority: HIGHEST for action security_group_members [ 799.134662] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d57e8cdf-1b06-49d3-ba61-715ba529bb2e with Priority: HIGHEST for action port [ 799.135779] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d78f0fb5-49a9-40c7-ad7a-277209d3d53c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.136243] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.136243] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.136243] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.136243] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d78f0fb5-49a9-40c7-ad7a-277209d3d53c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.137992] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.137992] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.137992] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.137992] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.137992] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.137992] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.137992] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.138761] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.138761] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.138761] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d78f0fb5-49a9-40c7-ad7a-277209d3d53c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.139654] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-d57e8cdf-1b06-49d3-ba61-715ba529bb2e taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.139765] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d57e8cdf-1b06-49d3-ba61-715ba529bb2e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.139765] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d57e8cdf-1b06-49d3-ba61-715ba529bb2e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.140205] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d57e8cdf-1b06-49d3-ba61-715ba529bb2e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.140205] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d57e8cdf-1b06-49d3-ba61-715ba529bb2e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.427230] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.427836] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.427836] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.427836] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.427836] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.428127] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35104466-92f1-4e6a-9df0-55e3f828079c is going to be updated. [ 799.445597] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 in Status: SUCCESS [ 799.445818] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.446214] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.446340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.446421] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.446621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.446703] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.446793] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d47d19df-e406-4c01-9cf0-1110c7c55440 is going to be updated. [ 799.447785] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.448634] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.448751] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.448816] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.448816] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.448977] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.449074] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.449182] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.449249] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.455300] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.455421] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.455491] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.455665] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.455815] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.466901] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35104466-92f1-4e6a-9df0-55e3f828079c in Status: IN_PROGRESS for 2s [ 799.478337] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.478337] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.478337] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.478337] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.478337] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.486747] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: IN_PROGRESS for 2s [ 799.504943] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1197cb6b-f6f8-4e0a-8b93-e11877f2e915',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.538180] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.538325] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.538394] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.538608] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.538768] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.538883] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.538952] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.539119] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.539204] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.539287] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.539427] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.539513] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.539570] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.539703] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.539832] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.539914] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.539969] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.540116] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.540186] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.540261] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.540344] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.643207] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.643207] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.643207] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d78f0fb5-49a9-40c7-ad7a-277209d3d53c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.643512] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d57e8cdf-1b06-49d3-ba61-715ba529bb2e with status ACTIVE [ 799.643512] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.643596] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.643667] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.643882] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.643952] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.644132] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.644237] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.644287] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.644435] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.644508] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.644679] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.644766] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.644824] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.644958] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.648208] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.648341] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d57e8cdf-1b06-49d3-ba61-715ba529bb2e is going to be updated. [ 799.672016] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.672188] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.672282] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.672533] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.672688] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.672868] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d57e8cdf-1b06-49d3-ba61-715ba529bb2e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.773421] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: SUCCESS [ 799.774131] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.774471] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.774901] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.775128] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.775271] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.775342] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.775516] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.775611] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.775716] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.953467] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b51e70d-5edb-4332-99e9-eb53e6015365 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.953668] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.953779] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.954075] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.954306] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.954445] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.954711] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.954783] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.954938] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.954989] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.955184] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b51e70d-5edb-4332-99e9-eb53e6015365 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.955315] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.955404] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.955596] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.955791] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.955921] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.957691] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.958091] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.958233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.958360] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.958663] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.007266] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1197cb6b-f6f8-4e0a-8b93-e11877f2e915: rpc.has_security_group_logging(os_id): False [ 800.026125] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.026355] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.026355] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.026550] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.026642] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.026881] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.027016] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.027016] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.027171] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.027252] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.027339] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 is going to be created. [ 800.042526] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c2da01b-6452-4ea7-a1ca-fac9de38da7b: rpc.has_security_group_logging(os_id): False [ 800.058935] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.059109] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.059187] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.059368] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.059462] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.059787] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.059787] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.059956] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.059995] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.060085] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.060295] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.060463] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.060530] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.060680] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.060771] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.061050] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.061150] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.061214] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.061359] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.061435] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.061523] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b is going to be updated. [ 800.093743] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.093901] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.093974] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.094583] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.094583] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.105670] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 in Status: IN_PROGRESS for 2s [ 800.122024] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.122982] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.123114] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.123314] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.123473] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.137507] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: IN_PROGRESS for 2s [ 800.151284] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d78f0fb5-49a9-40c7-ad7a-277209d3d53c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.283578] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.283578] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.283578] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.283578] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.283578] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.283578] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.283578] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.283578] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.283578] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.283578] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.283578] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86efc288-b26f-4298-9444-58202b5c40d5 is going to be updated. [ 800.313758] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.313935] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.314153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.314206] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.314346] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.322921] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: IN_PROGRESS for 2s [ 800.462795] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b51e70d-5edb-4332-99e9-eb53e6015365: rpc.has_security_group_logging(os_id): False [ 800.482392] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.484163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.484163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.484163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.484163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.484163] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.485378] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.485378] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.485378] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.485378] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.485378] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.485378] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.485645] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.485860] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.487550] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.487783] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.487908] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.487987] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.488118] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.488192] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.488283] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 is going to be created. [ 800.547294] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.547615] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.547873] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.548181] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.548520] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.562822] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 in Status: IN_PROGRESS for 2s [ 800.655253] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.655457] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.655684] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.655751] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.655885] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.656057] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d78f0fb5-49a9-40c7-ad7a-277209d3d53c is going to be created. [ 800.683546] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.683736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.683842] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.684129] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.684353] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.696657] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d78f0fb5-49a9-40c7-ad7a-277209d3d53c in Status: UNINITIALIZED for 2s [ 801.017099] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35104466-92f1-4e6a-9df0-55e3f828079c in Status: SUCCESS [ 801.017318] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.017524] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.017917] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.018032] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35104466-92f1-4e6a-9df0-55e3f828079c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.480984] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35104466-92f1-4e6a-9df0-55e3f828079c in Status: SUCCESS [ 801.481799] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.486795] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.486795] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.486795] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.486795] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.486795] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.486795] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.486795] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.486795] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35104466-92f1-4e6a-9df0-55e3f828079c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.498522] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: SUCCESS [ 801.498522] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.498522] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.498996] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.499321] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.499592] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.499841] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.500253] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.500444] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.500635] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.520777] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-35104466-92f1-4e6a-9df0-55e3f828079c taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.520928] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.991215] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('35104466-92f1-4e6a-9df0-55e3f828079c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.006873] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.117851] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 in Status: SUCCESS [ 802.118092] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.148273] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: SUCCESS [ 802.148490] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.289974] env[70013]: INFO networking_nsxv3.common.synchronization [req-b9a2b3dd-7d2e-481c-a073-48b4a3dc10d7 req-a53e5adc-4e28-4c19-893e-f8a5218bd4da tempest-MultipleCreateTestJSON-634477930 tempest-MultipleCreateTestJSON-634477930-project-member] Enqueued Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_members [ 802.290756] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_members [ 802.290903] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.291163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.291262] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.291486] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.291663] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.291816] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.291900] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.292142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.292142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.292258] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.333156] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: SUCCESS [ 802.333372] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86efc288-b26f-4298-9444-58202b5c40d5 deletion is rescheduled due to dependency. [ 802.334040] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.334040] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.334335] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.334488] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.334623] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.334682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.334885] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.334965] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.335086] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.493614] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('35104466-92f1-4e6a-9df0-55e3f828079c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.509747] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.573475] env[70013]: INFO networking_nsxv3.common.synchronization [req-acec40ea-eb4b-49de-9535-9e8609bfd877 req-c9ea20a9-c688-4ca8-bb56-4a5f7b8bda85 tempest-MultipleCreateTestJSON-634477930 tempest-MultipleCreateTestJSON-634477930-project-member] Enqueued Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_members [ 802.574828] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 in Status: SUCCESS [ 802.574828] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.575135] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_members [ 802.575505] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.575636] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.706247] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d78f0fb5-49a9-40c7-ad7a-277209d3d53c in Status: SUCCESS [ 802.706545] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.706770] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.706956] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.707175] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.707310] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.707415] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.707533] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.707613] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.707706] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.707822] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d78f0fb5-49a9-40c7-ad7a-277209d3d53c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.795937] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.837768] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.838057] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.838135] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.838386] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.838544] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.838823] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.838975] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.839065] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.839290] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.839381] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.839521] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86efc288-b26f-4298-9444-58202b5c40d5 is going to be updated. [ 802.864544] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.865608] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.865608] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.865608] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.865608] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.876161] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: IN_PROGRESS for 2s [ 802.996942] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.997044] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.997124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.997364] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.997463] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.997566] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35104466-92f1-4e6a-9df0-55e3f828079c is going to be updated. [ 803.012206] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.012206] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.012396] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.012483] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.012595] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.012717] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d47d19df-e406-4c01-9cf0-1110c7c55440 is going to be updated. [ 803.034037] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.034037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.034037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.034037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.034037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.044023] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.044023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.044023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.044023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.044023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.045618] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35104466-92f1-4e6a-9df0-55e3f828079c in Status: IN_PROGRESS for 2s [ 803.059822] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: IN_PROGRESS for 2s [ 803.210756] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.211031] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.211974] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.212771] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.212771] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.212771] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.212771] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.212771] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.213476] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.213476] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.213476] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.213476] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.213476] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.213476] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.213847] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.213959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.214035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.214303] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.214866] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.215013] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.215132] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d78f0fb5-49a9-40c7-ad7a-277209d3d53c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.298790] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.718329] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d78f0fb5-49a9-40c7-ad7a-277209d3d53c: rpc.has_security_group_logging(os_id): False [ 803.737807] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.737807] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.737807] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.738919] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.739076] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.739340] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.739454] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.739519] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.739732] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.739823] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.740475] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.740475] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.740475] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.740679] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.740679] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.740844] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.740904] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.740942] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.741115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.741175] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.741257] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d78f0fb5-49a9-40c7-ad7a-277209d3d53c is going to be created. [ 803.798878] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.799131] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.799251] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.799556] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.799850] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.804140] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.804266] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.804518] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.804518] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.804621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.804703] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b is going to be updated. [ 803.818265] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d78f0fb5-49a9-40c7-ad7a-277209d3d53c in Status: IN_PROGRESS for 2s [ 803.830944] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.831089] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.831147] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.831344] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.831486] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.838508] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: IN_PROGRESS for 2s [ 804.080344] env[70013]: INFO networking_nsxv3.common.synchronization [req-12c37d1e-4a8c-4334-b89e-b54cd80e651a req-1e2cfdc6-9e2e-4a7b-8cc3-44352f7e7d60 tempest-TenantUsagesTestJSON-190205799 tempest-TenantUsagesTestJSON-190205799-project-member] Enqueued Resource ID: be9ceb9b-c3fa-402d-911f-9098a39cc84e with Priority: HIGHEST for action security_group_members [ 804.080456] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9ceb9b-c3fa-402d-911f-9098a39cc84e with Priority: HIGHEST for action security_group_members [ 804.080720] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-be9ceb9b-c3fa-402d-911f-9098a39cc84e taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.080841] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.080901] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.081829] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.081965] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.082091] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.082170] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.082321] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.082420] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.082515] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be9ceb9b-c3fa-402d-911f-9098a39cc84e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.586143] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.586143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.586143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.586143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.586143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.586408] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.586733] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.586733] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.586733] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.586733] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.586911] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be9ceb9b-c3fa-402d-911f-9098a39cc84e already deleted. [ 804.586911] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.633844] env[70013]: INFO networking_nsxv3.common.synchronization [None req-ae99bed0-94e4-4461-af1f-0b6d3fa65bed None None] Enqueued Resource ID: 403435d7-dacb-4beb-9f9b-d6b625eca028 with Priority: HIGHEST for action port [ 804.634358] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 403435d7-dacb-4beb-9f9b-d6b625eca028 with Priority: HIGHEST for action port [ 804.634719] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-403435d7-dacb-4beb-9f9b-d6b625eca028 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.634856] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-403435d7-dacb-4beb-9f9b-d6b625eca028" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.634926] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-403435d7-dacb-4beb-9f9b-d6b625eca028" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.636262] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-403435d7-dacb-4beb-9f9b-d6b625eca028" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.636416] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('403435d7-dacb-4beb-9f9b-d6b625eca028',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.678090] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-701 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.678090] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.678090] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.678090] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.678388] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.678388] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.678557] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.678659] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.678817] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.682603] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 804.682872] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 804.683035] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 804.683223] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 804.683316] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 804.683416] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 804.683600] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 804.702335] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 804.702944] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 804.702944] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 804.702944] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.703226] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-9cdec97e-ce57-46c5-8d8f-1425a3452a72 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.703401] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-9cdec97e-ce57-46c5-8d8f-1425a3452a72" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.703533] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-9cdec97e-ce57-46c5-8d8f-1425a3452a72" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.703899] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-9cdec97e-ce57-46c5-8d8f-1425a3452a72" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.703957] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cdec97e-ce57-46c5-8d8f-1425a3452a72',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.886675] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: SUCCESS [ 804.886675] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86efc288-b26f-4298-9444-58202b5c40d5 deletion is rescheduled due to dependency. [ 804.886675] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.054380] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35104466-92f1-4e6a-9df0-55e3f828079c in Status: SUCCESS [ 805.054623] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.054797] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.055051] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.055273] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.056728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.056728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.056728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.056728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.056728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.056728] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('35104466-92f1-4e6a-9df0-55e3f828079c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.067886] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: SUCCESS [ 805.068135] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.068321] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.068560] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.068772] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.068921] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.069008] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.069209] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.069313] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.069431] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.069623] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.069744] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.069825] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.070010] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.070201] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.070334] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.070419] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.070603] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.070704] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.070799] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.070926] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.138625] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 403435d7-dacb-4beb-9f9b-d6b625eca028 [ 805.139566] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.140179] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.141208] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.141208] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.141208] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.141208] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:403435d7-dacb-4beb-9f9b-d6b625eca028 already deleted. [ 805.141208] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-403435d7-dacb-4beb-9f9b-d6b625eca028" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.208022] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.208022] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.208022] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.208022] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.208022] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.208329] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 9cdec97e-ce57-46c5-8d8f-1425a3452a72 not found, creating... [ 805.208497] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.208633] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.208739] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.208992] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.209150] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.209923] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.209923] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.209923] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.210115] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.213588] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.215168] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 9cdec97e-ce57-46c5-8d8f-1425a3452a72 is going to be created. [ 805.233463] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.233463] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.234758] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.234758] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.234758] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.234758] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-9cdec97e-ce57-46c5-8d8f-1425a3452a72" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.561059] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('35104466-92f1-4e6a-9df0-55e3f828079c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.573183] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d47d19df-e406-4c01-9cf0-1110c7c55440: rpc.has_security_group_logging(os_id): False [ 805.593111] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.593111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.593111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.593111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.593111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.593111] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.593111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.593111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.593111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.593111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.593111] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.593111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.593111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.593111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.593111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.594144] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.594301] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.594372] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.594536] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.594617] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.594706] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d47d19df-e406-4c01-9cf0-1110c7c55440 is going to be updated. [ 805.655866] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.656035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.656125] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.656360] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.656509] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.671189] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: IN_PROGRESS for 2s [ 805.829975] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d78f0fb5-49a9-40c7-ad7a-277209d3d53c in Status: SUCCESS [ 805.830436] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.848646] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: SUCCESS [ 805.848877] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.849062] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.849305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.849502] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.849649] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.849732] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.853020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.853020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.853020] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.062741] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 35104466-92f1-4e6a-9df0-55e3f828079c: rpc.has_security_group_logging(os_id): False [ 806.080491] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.080703] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.080703] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.080946] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.081061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.081296] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.081408] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.081474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.081626] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.081703] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.081809] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35104466-92f1-4e6a-9df0-55e3f828079c is going to be updated. [ 806.133347] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.133347] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.133514] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.133615] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.133754] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.145768] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35104466-92f1-4e6a-9df0-55e3f828079c in Status: IN_PROGRESS for 2s [ 806.147331] env[70013]: INFO networking_nsxv3.common.synchronization [req-12c37d1e-4a8c-4334-b89e-b54cd80e651a req-7ff7aa65-a9b4-4cd5-a3ca-a7c3e8d4576f service nova] Enqueued Resource ID: be9ceb9b-c3fa-402d-911f-9098a39cc84e with Priority: HIGHEST for action security_group_rules [ 806.147506] env[70013]: INFO networking_nsxv3.common.synchronization [req-12c37d1e-4a8c-4334-b89e-b54cd80e651a req-7ff7aa65-a9b4-4cd5-a3ca-a7c3e8d4576f service nova] Enqueued Resource ID: be9ceb9b-c3fa-402d-911f-9098a39cc84e with Priority: HIGHEST for action security_group_members [ 806.147641] env[70013]: INFO networking_nsxv3.common.synchronization [req-12c37d1e-4a8c-4334-b89e-b54cd80e651a req-7ff7aa65-a9b4-4cd5-a3ca-a7c3e8d4576f service nova] Enqueued Resource ID: 9cdec97e-ce57-46c5-8d8f-1425a3452a72 with Priority: HIGHEST for action port [ 806.147859] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9ceb9b-c3fa-402d-911f-9098a39cc84e with Priority: HIGHEST for action security_group_rules [ 806.148015] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9ceb9b-c3fa-402d-911f-9098a39cc84e with Priority: HIGHEST for action security_group_members [ 806.148295] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cdec97e-ce57-46c5-8d8f-1425a3452a72 with Priority: HIGHEST for action port [ 806.148909] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be9ceb9b-c3fa-402d-911f-9098a39cc84e taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.149088] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.149183] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.149495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.149638] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be9ceb9b-c3fa-402d-911f-9098a39cc84e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.151543] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-be9ceb9b-c3fa-402d-911f-9098a39cc84e taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.151676] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.151837] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.152000] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.152186] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.152286] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.154598] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.154598] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.154598] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.154598] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be9ceb9b-c3fa-402d-911f-9098a39cc84e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.154598] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cdec97e-ce57-46c5-8d8f-1425a3452a72 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.154598] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cdec97e-ce57-46c5-8d8f-1425a3452a72" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.154598] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cdec97e-ce57-46c5-8d8f-1425a3452a72" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.154598] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cdec97e-ce57-46c5-8d8f-1425a3452a72" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.154598] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cdec97e-ce57-46c5-8d8f-1425a3452a72',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.352557] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.352557] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.352557] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.352894] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.353333] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.353333] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.353558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.353558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.353652] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.353766] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.353885] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b is going to be updated. [ 806.377105] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.377105] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.377105] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.377248] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.377418] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.385215] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: IN_PROGRESS for 2s [ 806.655490] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-be9ceb9b-c3fa-402d-911f-9098a39cc84e taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.655626] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.655807] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('be9ceb9b-c3fa-402d-911f-9098a39cc84e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.656788] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9cdec97e-ce57-46c5-8d8f-1425a3452a72 with status ACTIVE [ 806.656982] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.657101] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.657170] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.657380] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.657468] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.657637] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.657730] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.657793] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.658610] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.658610] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.658610] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.658610] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.658610] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.662303] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.663852] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.663852] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9cdec97e-ce57-46c5-8d8f-1425a3452a72 is going to be updated. [ 806.684203] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.684203] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.684203] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.684203] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.684203] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.684203] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cdec97e-ce57-46c5-8d8f-1425a3452a72" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.749057] env[70013]: INFO networking_nsxv3.common.synchronization [req-c5d8f147-0bd3-46b6-bc13-24ad436d43c7 req-a9f288f7-a397-4c86-858d-595d074f4958 tempest-ImagesTestJSON-851757871 tempest-ImagesTestJSON-851757871-project-member] Enqueued Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 806.749057] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 806.749057] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.749057] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.749057] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.749397] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.749693] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.750112] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.750320] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.750592] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.750819] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.752564] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.856679] env[70013]: INFO networking_nsxv3.common.synchronization [None req-6ff20e5e-2295-4022-ad5d-6c8d49e815c1 None None] Enqueued Resource ID: c08cc90a-6874-4fa4-b540-eab75243e0ab with Priority: HIGHEST for action port [ 806.857076] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c08cc90a-6874-4fa4-b540-eab75243e0ab with Priority: HIGHEST for action port [ 806.857329] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-c08cc90a-6874-4fa4-b540-eab75243e0ab taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.857457] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c08cc90a-6874-4fa4-b540-eab75243e0ab" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.857507] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c08cc90a-6874-4fa4-b540-eab75243e0ab" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.857899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c08cc90a-6874-4fa4-b540-eab75243e0ab" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.857899] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c08cc90a-6874-4fa4-b540-eab75243e0ab',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.164815] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('be9ceb9b-c3fa-402d-911f-9098a39cc84e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.254527] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.254675] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.254854] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.254971] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.255077] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.255305] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.255399] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.255444] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.255597] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.255657] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.255741] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 is going to be updated. [ 807.281127] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.281272] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.281335] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.281558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.281696] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.289883] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: IN_PROGRESS for 2s [ 807.361783] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c08cc90a-6874-4fa4-b540-eab75243e0ab [ 807.361783] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.361783] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.361783] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.361783] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.361783] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.361783] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c08cc90a-6874-4fa4-b540-eab75243e0ab already deleted. [ 807.361783] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c08cc90a-6874-4fa4-b540-eab75243e0ab" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.416274] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-875 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.416485] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-875" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.416605] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-875" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.416871] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-875" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.417165] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.417325] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.417443] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.417663] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.417968] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.418542] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 807.418699] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 807.418880] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 807.419025] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 807.419149] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 807.419259] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 807.419393] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 807.437470] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 807.437638] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 807.437779] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 807.437962] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-875" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.438667] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-9071978f-4173-4873-86de-85c11de7ddb7 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.438667] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-9071978f-4173-4873-86de-85c11de7ddb7" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.438667] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-9071978f-4173-4873-86de-85c11de7ddb7" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.438904] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-9071978f-4173-4873-86de-85c11de7ddb7" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.438997] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9071978f-4173-4873-86de-85c11de7ddb7',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.667207] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.667368] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.667445] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.667649] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.667741] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.667847] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be9ceb9b-c3fa-402d-911f-9098a39cc84e is going to be created. [ 807.684510] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: SUCCESS [ 807.684726] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.684895] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.685128] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.685219] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.692601] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.692733] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.692866] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.693079] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.693245] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.701877] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be9ceb9b-c3fa-402d-911f-9098a39cc84e in Status: UNINITIALIZED for 2s [ 807.941900] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.942192] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.942434] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.946023] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.946023] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.946023] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 9071978f-4173-4873-86de-85c11de7ddb7 not found, creating... [ 807.946023] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.946023] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.946023] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.946023] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.946023] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.946023] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.946023] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.946671] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.946671] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.946671] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.946671] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 9071978f-4173-4873-86de-85c11de7ddb7 is going to be created. [ 807.967340] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.967648] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.967712] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.968019] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.968264] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.968485] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-9071978f-4173-4873-86de-85c11de7ddb7" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.164078] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35104466-92f1-4e6a-9df0-55e3f828079c in Status: SUCCESS [ 808.164968] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.189796] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.189796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.189796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.189796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.189796] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.189796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.189796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.189796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.189796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.189796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.189796] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.240316] env[70013]: INFO networking_nsxv3.common.synchronization [req-fa634777-fa41-4b34-a6a5-0da2c1afa42e req-6906e1e9-5302-483b-bd79-af473319723b tempest-DeleteServersTestJSON-1971284771 tempest-DeleteServersTestJSON-1971284771-project-member] Enqueued Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 808.240739] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 808.241590] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.241879] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.241879] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.242391] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.242572] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.243301] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.243301] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.243301] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.243301] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.243301] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.337872] env[70013]: INFO networking_nsxv3.common.synchronization [req-9c7b241b-b181-42d5-8145-f051dc8a0875 req-3f3b86b0-e892-4ee7-90fc-035c5b83b142 tempest-VolumesAdminNegativeTest-973826376 tempest-VolumesAdminNegativeTest-973826376-project-member] Enqueued Resource ID: aa7b798e-2025-4d46-88f3-8e44eeb87989 with Priority: HIGHEST for action security_group_members [ 808.338662] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7b798e-2025-4d46-88f3-8e44eeb87989 with Priority: HIGHEST for action security_group_members [ 808.339596] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7b798e-2025-4d46-88f3-8e44eeb87989 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.339889] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.340909] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.341238] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.341442] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.341581] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.341650] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.341900] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.341991] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.342107] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa7b798e-2025-4d46-88f3-8e44eeb87989',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.395265] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: SUCCESS [ 808.396330] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b deletion is rescheduled due to dependency. [ 808.396586] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.694832] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.694832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.694832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.694832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.694832] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.694832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.694832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.694832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.694832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.694832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.694832] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.694832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.694832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.694832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.694832] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.694832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.695705] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.695705] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.695705] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.695705] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.695705] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.747813] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.747813] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.747813] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.747813] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.747813] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.747813] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.747813] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.747813] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.747813] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.747813] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.747813] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b is going to be updated. [ 808.776072] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.776072] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.776072] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.776072] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.776072] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.782568] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: IN_PROGRESS for 2s [ 808.848724] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.848724] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.848724] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.848724] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.848724] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.848724] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.848724] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.848724] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.848724] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.848724] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.848724] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa7b798e-2025-4d46-88f3-8e44eeb87989 is going to be updated. [ 808.906640] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.906640] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.906640] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.906640] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.907028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.922042] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7b798e-2025-4d46-88f3-8e44eeb87989 in Status: IN_PROGRESS for 2s [ 809.017768] env[70013]: INFO networking_nsxv3.common.synchronization [req-c5d8f147-0bd3-46b6-bc13-24ad436d43c7 req-2a0f505b-545d-486f-8b4e-00f7df669b83 service nova] Enqueued Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_rules [ 809.017980] env[70013]: INFO networking_nsxv3.common.synchronization [req-c5d8f147-0bd3-46b6-bc13-24ad436d43c7 req-2a0f505b-545d-486f-8b4e-00f7df669b83 service nova] Enqueued Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 809.018631] env[70013]: INFO networking_nsxv3.common.synchronization [req-c5d8f147-0bd3-46b6-bc13-24ad436d43c7 req-2a0f505b-545d-486f-8b4e-00f7df669b83 service nova] Enqueued Resource ID: 9071978f-4173-4873-86de-85c11de7ddb7 with Priority: HIGHEST for action port [ 809.018719] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_rules [ 809.019379] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 809.019581] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9071978f-4173-4873-86de-85c11de7ddb7 with Priority: HIGHEST for action port [ 809.019935] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.020118] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.020241] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.020497] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.020635] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.021533] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.021671] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.021957] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-9071978f-4173-4873-86de-85c11de7ddb7 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.022136] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9071978f-4173-4873-86de-85c11de7ddb7" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.022256] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9071978f-4173-4873-86de-85c11de7ddb7" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.022489] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9071978f-4173-4873-86de-85c11de7ddb7" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.022633] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9071978f-4173-4873-86de-85c11de7ddb7',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.200241] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d47d19df-e406-4c01-9cf0-1110c7c55440: rpc.has_security_group_logging(os_id): False [ 809.230602] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.230602] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.230602] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.230602] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.230602] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.230602] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.230602] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.230602] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.230602] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.230602] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.230602] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.230602] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.230602] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.230602] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.230602] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.231203] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.232389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.232389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.232389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.232594] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.232594] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d47d19df-e406-4c01-9cf0-1110c7c55440 is going to be updated. [ 809.292386] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.292662] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.292776] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.292949] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.293148] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.304062] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: SUCCESS [ 809.304062] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 deletion is rescheduled due to dependency. [ 809.304062] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.304232] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.304642] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.304642] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.304774] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.304774] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.304878] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.305069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.305069] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.309065] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: IN_PROGRESS for 2s [ 809.528469] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.528469] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.528469] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9071978f-4173-4873-86de-85c11de7ddb7 with status ACTIVE [ 809.528469] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.528469] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.528469] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.528469] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.528469] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.528469] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.528469] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.528469] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.528469] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.528469] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.528469] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.528986] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.528986] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.528986] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.528986] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.528986] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9071978f-4173-4873-86de-85c11de7ddb7 is going to be updated. [ 809.549677] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.549677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.549677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.549677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.549677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.549677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9071978f-4173-4873-86de-85c11de7ddb7" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.714380] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be9ceb9b-c3fa-402d-911f-9098a39cc84e in Status: SUCCESS [ 809.714638] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.714867] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.715197] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.715465] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.715629] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.715722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.715952] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.716099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.716229] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.716409] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('be9ceb9b-c3fa-402d-911f-9098a39cc84e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.809396] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.821077] env[70013]: INFO networking_nsxv3.common.synchronization [req-97b038d7-5c97-459a-bfd3-232826b9f6ba req-f5b03564-dcdb-4975-8112-671d7c4db40e tempest-ServerGroupTestJSON-297588656 tempest-ServerGroupTestJSON-297588656-project-member] Enqueued Resource ID: d78f0fb5-49a9-40c7-ad7a-277209d3d53c with Priority: HIGHEST for action security_group_members [ 809.821591] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d78f0fb5-49a9-40c7-ad7a-277209d3d53c with Priority: HIGHEST for action security_group_members [ 809.822027] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.822556] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.822656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.824658] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.824658] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.824658] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.824658] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.824658] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.824658] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.824658] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d78f0fb5-49a9-40c7-ad7a-277209d3d53c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.223688] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-be9ceb9b-c3fa-402d-911f-9098a39cc84e taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.223688] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.223688] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.223688] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.223688] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.223688] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.223688] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.223688] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.223688] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.223688] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.223688] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-be9ceb9b-c3fa-402d-911f-9098a39cc84e taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.223688] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.223688] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.223688] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.223688] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.223688] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.224618] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.224618] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.224618] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.224618] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.224618] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('be9ceb9b-c3fa-402d-911f-9098a39cc84e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.313328] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.326921] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.327137] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.327249] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.327438] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.327555] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.327758] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.327892] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.327985] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.331028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.331028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.331028] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d78f0fb5-49a9-40c7-ad7a-277209d3d53c is going to be updated. [ 810.354377] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.354555] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.354621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.354814] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.355060] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.362944] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d78f0fb5-49a9-40c7-ad7a-277209d3d53c in Status: IN_PROGRESS for 2s [ 810.726286] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for be9ceb9b-c3fa-402d-911f-9098a39cc84e: rpc.has_security_group_logging(os_id): False [ 810.747475] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.747708] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.747708] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.747970] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.747970] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.748201] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.748351] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.748351] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.748556] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.748556] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.748744] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.748844] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.748992] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.749283] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.749403] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.749600] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.749722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.749722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.749864] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.749932] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.749992] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be9ceb9b-c3fa-402d-911f-9098a39cc84e is going to be created. [ 810.807436] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: SUCCESS [ 810.807626] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b deletion is rescheduled due to dependency. [ 810.810113] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.818261] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.818477] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.818477] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.818692] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.818920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.821330] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.821330] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.821330] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.821330] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.821330] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.821330] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 is going to be updated. [ 810.836907] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be9ceb9b-c3fa-402d-911f-9098a39cc84e in Status: IN_PROGRESS for 2s [ 810.856075] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.856075] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.856075] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.856426] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.856511] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.870774] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: IN_PROGRESS for 2s [ 810.932239] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7b798e-2025-4d46-88f3-8e44eeb87989 in Status: SUCCESS [ 810.932462] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa7b798e-2025-4d46-88f3-8e44eeb87989 deletion is rescheduled due to dependency. [ 810.932586] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.328730] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: SUCCESS [ 811.329030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.388405] env[70013]: INFO networking_nsxv3.common.synchronization [None req-cf0b0d95-89d7-4f58-a16f-1342ff3a994e None None] Enqueued Resource ID: acab93ca-d51b-4f93-9afe-fc941bb8a711 with Priority: HIGHEST for action port [ 811.388405] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acab93ca-d51b-4f93-9afe-fc941bb8a711 with Priority: HIGHEST for action port [ 811.388639] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-acab93ca-d51b-4f93-9afe-fc941bb8a711 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.388747] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acab93ca-d51b-4f93-9afe-fc941bb8a711" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.388794] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acab93ca-d51b-4f93-9afe-fc941bb8a711" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.389273] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acab93ca-d51b-4f93-9afe-fc941bb8a711" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.389398] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acab93ca-d51b-4f93-9afe-fc941bb8a711',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.732077] env[70013]: INFO networking_nsxv3.common.synchronization [req-9ee25f95-b132-43c8-bccd-7aca01458834 req-7fbb72dd-0cf0-4377-ba32-659eab0b17a2 tempest-ServersTestJSON-1543902807 tempest-ServersTestJSON-1543902807-project-member] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 811.732587] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 811.734405] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.734540] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.734610] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.734816] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.735945] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.735945] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.735945] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.735945] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.735945] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.735945] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.892129] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port acab93ca-d51b-4f93-9afe-fc941bb8a711 [ 811.892410] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.893405] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.893405] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.893405] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.893405] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.893405] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:acab93ca-d51b-4f93-9afe-fc941bb8a711 already deleted. [ 811.893405] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acab93ca-d51b-4f93-9afe-fc941bb8a711" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.088191] env[70013]: INFO networking_nsxv3.common.synchronization [None req-82701cd2-64d5-42ce-b6b7-0cf8472eb2a7 tempest-ServerActionsTestOtherA-108106573 tempest-ServerActionsTestOtherA-108106573-project-member] Enqueued Resource ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c with Priority: HIGHEST for action security_group_rules [ 812.088718] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c with Priority: HIGHEST for action security_group_rules [ 812.089250] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.089250] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.089250] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.089462] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.089599] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca27a1b0-973f-4958-8f7f-a5c216cb9a8c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.176736] env[70013]: INFO networking_nsxv3.common.synchronization [None req-408962d8-60e5-44b8-bdf3-df8d38a9e09b tempest-ServerActionsTestOtherA-108106573 tempest-ServerActionsTestOtherA-108106573-project-member] Enqueued Resource ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c with Priority: HIGHEST for action security_group_rules [ 812.178227] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c with Priority: HIGHEST for action security_group_rules [ 812.178872] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.179158] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.240896] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.267245] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-250 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.267418] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-250" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.267562] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-250" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.267870] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-250" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.268144] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.268301] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.268418] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.268642] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.268986] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.269172] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 812.270655] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 812.270780] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 812.270910] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 812.271045] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 812.271168] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 812.271311] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 812.298032] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 812.298032] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 812.298032] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 812.298032] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-250" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.298032] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-40c50349-5efa-4257-b479-b8632c4d6a66 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.298032] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-40c50349-5efa-4257-b479-b8632c4d6a66" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.298032] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-40c50349-5efa-4257-b479-b8632c4d6a66" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.298032] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-40c50349-5efa-4257-b479-b8632c4d6a66" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.298032] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40c50349-5efa-4257-b479-b8632c4d6a66',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.371974] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d78f0fb5-49a9-40c7-ad7a-277209d3d53c in Status: SUCCESS [ 812.372883] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d78f0fb5-49a9-40c7-ad7a-277209d3d53c deletion is rescheduled due to dependency. [ 812.372883] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.612650] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.614852] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.614852] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.614852] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.614852] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.614852] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c already deleted. [ 812.614852] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.614852] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.614852] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.614852] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca27a1b0-973f-4958-8f7f-a5c216cb9a8c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.745352] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.800477] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.800691] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.800817] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.801116] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.801264] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.801420] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 40c50349-5efa-4257-b479-b8632c4d6a66 not found, creating... [ 812.801690] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.801893] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.802034] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.802252] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.802386] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.802665] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.802956] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.803067] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.803250] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.803387] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.803525] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 40c50349-5efa-4257-b479-b8632c4d6a66 is going to be created. [ 812.822347] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.822559] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.822684] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.822986] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.823235] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.823464] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-40c50349-5efa-4257-b479-b8632c4d6a66" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.848417] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: be9ceb9b-c3fa-402d-911f-9098a39cc84e in Status: SUCCESS [ 812.848417] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.880351] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: SUCCESS [ 812.880569] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.880736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.880958] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.881162] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.881281] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.881348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.881499] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.881580] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.881666] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.881759] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.158555] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.158555] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.158555] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.158555] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.158555] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.158555] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c already deleted. [ 813.158555] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.248336] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.248493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.248563] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.248773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.248857] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.248953] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a is going to be updated. [ 813.277320] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.277320] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.277320] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.277320] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.277320] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.284903] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: IN_PROGRESS for 2s [ 813.391022] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.391022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.391022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.391022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.391022] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.391022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.391022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.391022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.391022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.391022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.391022] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.391022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.391022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.391022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.391022] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.391022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.392101] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.392101] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.392101] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.392101] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.392101] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.439156] env[70013]: INFO networking_nsxv3.common.synchronization [None req-fbe3c97d-7dd4-4207-923e-a7d6f960e756 None None] Enqueued Resource ID: 4417f7ce-44d2-4453-9b80-883e4e2966b6 with Priority: HIGHEST for action port [ 813.439156] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4417f7ce-44d2-4453-9b80-883e4e2966b6 with Priority: HIGHEST for action port [ 813.439156] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-4417f7ce-44d2-4453-9b80-883e4e2966b6 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.439156] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4417f7ce-44d2-4453-9b80-883e4e2966b6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.439156] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4417f7ce-44d2-4453-9b80-883e4e2966b6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.439156] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4417f7ce-44d2-4453-9b80-883e4e2966b6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.439156] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4417f7ce-44d2-4453-9b80-883e4e2966b6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.754709] env[70013]: INFO networking_nsxv3.common.synchronization [req-9ee25f95-b132-43c8-bccd-7aca01458834 req-50a76d84-4e7f-410f-8641-8bd9a17d7a12 service nova] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_rules [ 813.755077] env[70013]: INFO networking_nsxv3.common.synchronization [req-9ee25f95-b132-43c8-bccd-7aca01458834 req-50a76d84-4e7f-410f-8641-8bd9a17d7a12 service nova] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 813.755077] env[70013]: INFO networking_nsxv3.common.synchronization [req-9ee25f95-b132-43c8-bccd-7aca01458834 req-50a76d84-4e7f-410f-8641-8bd9a17d7a12 service nova] Enqueued Resource ID: 40c50349-5efa-4257-b479-b8632c4d6a66 with Priority: HIGHEST for action port [ 813.755493] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_rules [ 813.755493] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 813.755493] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40c50349-5efa-4257-b479-b8632c4d6a66 with Priority: HIGHEST for action port [ 813.756486] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.756674] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.756727] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.756910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.756990] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.758274] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.758374] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.758569] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-40c50349-5efa-4257-b479-b8632c4d6a66 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.758673] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40c50349-5efa-4257-b479-b8632c4d6a66" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.758739] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40c50349-5efa-4257-b479-b8632c4d6a66" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.758930] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40c50349-5efa-4257-b479-b8632c4d6a66" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.759029] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40c50349-5efa-4257-b479-b8632c4d6a66',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.894130] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc1b714b-7da7-41dc-b21f-d8ad167c33d9: rpc.has_security_group_logging(os_id): False [ 813.914081] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.914942] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.914942] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.914942] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.914942] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.915235] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.915235] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.915235] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.915354] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.915446] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.915612] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.915715] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.915779] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.915924] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.916007] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.916198] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.916324] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.916381] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.916525] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.916599] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.916712] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 is going to be updated. [ 813.943461] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4417f7ce-44d2-4453-9b80-883e4e2966b6 [ 813.944747] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.944747] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.944747] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.944747] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.944747] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.944747] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4417f7ce-44d2-4453-9b80-883e4e2966b6 already deleted. [ 813.944747] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4417f7ce-44d2-4453-9b80-883e4e2966b6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.976569] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.976753] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.976753] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.976887] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.977077] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.999669] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: IN_PROGRESS for 2s [ 814.261022] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.261160] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.261352] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40c50349-5efa-4257-b479-b8632c4d6a66 with status ACTIVE [ 814.261522] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.261625] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.261687] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.261948] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.262050] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.262227] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.262332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.262399] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.262561] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.262643] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.262869] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.262965] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.263047] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.263216] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.263278] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.263322] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40c50349-5efa-4257-b479-b8632c4d6a66 is going to be updated. [ 814.297574] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.297574] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.297574] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.297574] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.297574] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.297574] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40c50349-5efa-4257-b479-b8632c4d6a66" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.478461] env[70013]: INFO networking_nsxv3.common.synchronization [req-86e6aeba-c9ad-4125-86eb-e85b283d86bb req-f83ecb2b-dfbb-410e-a69a-afd03e248842 tempest-ServersWithSpecificFlavorTestJSON-1827464871 tempest-ServersWithSpecificFlavorTestJSON-1827464871-project-member] Enqueued Resource ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 with Priority: HIGHEST for action security_group_members [ 814.480452] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 with Priority: HIGHEST for action security_group_members [ 814.480580] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.481147] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.481147] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.481275] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.481514] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.481514] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.481610] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.481732] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.482015] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.482015] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.937268] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-2 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.937533] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.937748] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.938115] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.938376] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.938788] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.938788] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.938921] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.939099] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.939322] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 814.939437] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 814.939547] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 814.939657] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 814.939767] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 814.939878] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 814.940022] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 814.958113] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 814.958299] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 814.958435] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 814.958611] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.958929] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-320d056b-ab7e-455d-a9dc-f443a22fc563 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.959157] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-320d056b-ab7e-455d-a9dc-f443a22fc563" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.959298] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-320d056b-ab7e-455d-a9dc-f443a22fc563" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.959612] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-320d056b-ab7e-455d-a9dc-f443a22fc563" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.959749] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('320d056b-ab7e-455d-a9dc-f443a22fc563',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.984278] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.984700] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.984700] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.985183] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.985183] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.985183] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.985183] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.985183] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.985481] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.985481] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.985481] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 is going to be updated. [ 815.013378] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.013655] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.013655] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.014468] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.014766] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.022428] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 in Status: IN_PROGRESS for 2s [ 815.295717] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: SUCCESS [ 815.295958] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.296141] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.296362] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.296549] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.296835] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.296835] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.297025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.297025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.297090] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.469098] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.469098] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.469098] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.469098] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.469098] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.469098] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 320d056b-ab7e-455d-a9dc-f443a22fc563 not found, creating... [ 815.469098] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.469098] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.469098] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.469098] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.469098] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.469632] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.469632] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.469632] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.469632] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.469815] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.469982] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 320d056b-ab7e-455d-a9dc-f443a22fc563 is going to be created. [ 815.488867] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.489203] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.489203] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.489529] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.489672] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.489898] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-320d056b-ab7e-455d-a9dc-f443a22fc563" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.798744] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.013472] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: SUCCESS [ 816.013774] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.301748] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.543462] env[70013]: INFO networking_nsxv3.common.synchronization [req-86e6aeba-c9ad-4125-86eb-e85b283d86bb req-4b712230-692d-4661-997c-0536444e92b5 service nova] Enqueued Resource ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 with Priority: HIGHEST for action security_group_rules [ 816.543723] env[70013]: INFO networking_nsxv3.common.synchronization [req-86e6aeba-c9ad-4125-86eb-e85b283d86bb req-4b712230-692d-4661-997c-0536444e92b5 service nova] Enqueued Resource ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 with Priority: HIGHEST for action security_group_members [ 816.543759] env[70013]: INFO networking_nsxv3.common.synchronization [req-86e6aeba-c9ad-4125-86eb-e85b283d86bb req-4b712230-692d-4661-997c-0536444e92b5 service nova] Enqueued Resource ID: 320d056b-ab7e-455d-a9dc-f443a22fc563 with Priority: HIGHEST for action port [ 816.543983] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 with Priority: HIGHEST for action security_group_rules [ 816.544134] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 with Priority: HIGHEST for action security_group_members [ 816.544310] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 320d056b-ab7e-455d-a9dc-f443a22fc563 with Priority: HIGHEST for action port [ 816.544786] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.544910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.544979] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.545345] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.545498] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.547025] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.547025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.547025] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-320d056b-ab7e-455d-a9dc-f443a22fc563 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.547025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-320d056b-ab7e-455d-a9dc-f443a22fc563" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.547025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-320d056b-ab7e-455d-a9dc-f443a22fc563" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.547025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-320d056b-ab7e-455d-a9dc-f443a22fc563" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.547025] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('320d056b-ab7e-455d-a9dc-f443a22fc563',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.803848] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.804100] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.804100] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.804320] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.804557] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.804557] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a is going to be updated. [ 816.849032] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.849267] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.849307] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.849516] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.849667] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.858297] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: IN_PROGRESS for 2s [ 817.033514] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 in Status: SUCCESS [ 817.033749] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 deletion is rescheduled due to dependency. [ 817.033891] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.034392] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.034645] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.034902] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.035093] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.035207] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.035443] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.035630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.035807] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.048233] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.048401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.051048] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 320d056b-ab7e-455d-a9dc-f443a22fc563 with status ACTIVE [ 817.051374] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.051564] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.051670] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.052070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.052070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.052266] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.052341] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.052442] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.052573] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.052652] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.052834] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.052929] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.052992] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.053155] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.053223] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.053309] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 320d056b-ab7e-455d-a9dc-f443a22fc563 is going to be updated. [ 817.073857] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.074058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.074058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.074288] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.074429] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.074592] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-320d056b-ab7e-455d-a9dc-f443a22fc563" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.176561] env[70013]: INFO networking_nsxv3.common.synchronization [req-857d54f6-e09d-4957-be79-d3e16d8d2918 req-d158c70f-19b2-403c-9950-b61c5f65f854 tempest-ImagesOneServerNegativeTestJSON-165560685 tempest-ImagesOneServerNegativeTestJSON-165560685-project-member] Enqueued Resource ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 with Priority: HIGHEST for action security_group_members [ 817.177150] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 with Priority: HIGHEST for action security_group_members [ 817.177717] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d98818b-c2c5-4242-8897-fe65d03027a5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.177798] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.177871] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.178079] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.178234] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.178334] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.178394] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.178560] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.178640] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.178733] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d98818b-c2c5-4242-8897-fe65d03027a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.538126] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.685141] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.685141] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.685141] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.687520] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.687520] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.687520] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.687520] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.687520] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.687520] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.687520] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.687520] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 is going to be updated. [ 817.715335] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.715537] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.715630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.715809] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.715964] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.726453] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 in Status: IN_PROGRESS for 2s [ 817.800404] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-796 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.800540] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-796" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.800721] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-796" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.801055] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-796" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.801398] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.801606] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.801728] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.802058] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.802246] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.802445] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 817.802542] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 817.802653] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 817.802816] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 817.802877] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 817.803093] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 817.803215] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 817.823242] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 817.823242] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 817.823242] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 817.823242] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-796" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.823242] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-f1554235-9a1a-4e1a-9f15-a47bfe87eddd taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.823242] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-f1554235-9a1a-4e1a-9f15-a47bfe87eddd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.823242] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-f1554235-9a1a-4e1a-9f15-a47bfe87eddd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.823242] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-f1554235-9a1a-4e1a-9f15-a47bfe87eddd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.823242] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1554235-9a1a-4e1a-9f15-a47bfe87eddd',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.040743] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.327019] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.327019] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.327019] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.327019] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.327019] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.327019] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port f1554235-9a1a-4e1a-9f15-a47bfe87eddd not found, creating... [ 818.327019] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.327019] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.327019] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.327019] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.327019] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.327871] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.328191] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.328418] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.328740] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.328984] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.329253] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: f1554235-9a1a-4e1a-9f15-a47bfe87eddd is going to be created. [ 818.349453] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.349453] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.349692] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.349824] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.350125] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.350360] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-f1554235-9a1a-4e1a-9f15-a47bfe87eddd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.379756] env[70013]: INFO networking_nsxv3.common.synchronization [req-ec001563-4b07-487a-83d5-db05d72e8e1f req-dcc54c11-f905-43f6-a294-741e4d74f22d tempest-TenantUsagesTestJSON-190205799 tempest-TenantUsagesTestJSON-190205799-project-member] Enqueued Resource ID: be9ceb9b-c3fa-402d-911f-9098a39cc84e with Priority: HIGHEST for action security_group_members [ 818.379964] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9ceb9b-c3fa-402d-911f-9098a39cc84e with Priority: HIGHEST for action security_group_members [ 818.380253] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-be9ceb9b-c3fa-402d-911f-9098a39cc84e taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.380396] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.380463] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.380662] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.380810] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.380902] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.380961] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.381892] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.381999] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.382089] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('be9ceb9b-c3fa-402d-911f-9098a39cc84e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.545372] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.545513] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.545607] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.545812] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.545907] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.546016] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 is going to be updated. [ 818.580620] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.580780] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.580834] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.581056] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.581205] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.588999] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 in Status: IN_PROGRESS for 2s [ 818.870028] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: SUCCESS [ 818.870293] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.870466] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.870686] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.870906] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.871086] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.871134] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.871293] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.871352] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.871443] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.871539] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.884238] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.884440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.884506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.884689] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.884779] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.884984] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.885105] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.885168] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.885327] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.885404] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.885491] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be9ceb9b-c3fa-402d-911f-9098a39cc84e is going to be updated. [ 818.911800] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.912046] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.912046] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.912258] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.912426] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.935941] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be9ceb9b-c3fa-402d-911f-9098a39cc84e in Status: IN_PROGRESS for 2s [ 819.286247] env[70013]: INFO networking_nsxv3.common.synchronization [req-857d54f6-e09d-4957-be79-d3e16d8d2918 req-125b5d80-b069-4e05-8335-9b3b878ba912 service nova] Enqueued Resource ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 with Priority: HIGHEST for action security_group_rules [ 819.286247] env[70013]: INFO networking_nsxv3.common.synchronization [req-857d54f6-e09d-4957-be79-d3e16d8d2918 req-125b5d80-b069-4e05-8335-9b3b878ba912 service nova] Enqueued Resource ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 with Priority: HIGHEST for action security_group_members [ 819.286247] env[70013]: INFO networking_nsxv3.common.synchronization [req-857d54f6-e09d-4957-be79-d3e16d8d2918 req-125b5d80-b069-4e05-8335-9b3b878ba912 service nova] Enqueued Resource ID: f1554235-9a1a-4e1a-9f15-a47bfe87eddd with Priority: HIGHEST for action port [ 819.286247] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 with Priority: HIGHEST for action security_group_rules [ 819.286247] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 with Priority: HIGHEST for action security_group_members [ 819.286247] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1554235-9a1a-4e1a-9f15-a47bfe87eddd with Priority: HIGHEST for action port [ 819.287480] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d98818b-c2c5-4242-8897-fe65d03027a5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.287480] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.287480] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.287480] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.287480] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d98818b-c2c5-4242-8897-fe65d03027a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.288367] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d98818b-c2c5-4242-8897-fe65d03027a5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.288490] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.288689] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1554235-9a1a-4e1a-9f15-a47bfe87eddd taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.289546] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1554235-9a1a-4e1a-9f15-a47bfe87eddd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.289546] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1554235-9a1a-4e1a-9f15-a47bfe87eddd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.289546] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1554235-9a1a-4e1a-9f15-a47bfe87eddd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.289546] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1554235-9a1a-4e1a-9f15-a47bfe87eddd',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.374562] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.374725] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.374791] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.375055] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.375201] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.375339] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.375393] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.375548] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.375637] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.375736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.375881] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.375988] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.376061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.376224] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.376443] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.376499] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.376533] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.376661] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.376735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.376815] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.376905] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.736407] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 in Status: SUCCESS [ 819.736407] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 deletion is rescheduled due to dependency. [ 819.736596] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.736596] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.736840] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.736988] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.737199] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.737199] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.737403] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.737403] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.737495] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d98818b-c2c5-4242-8897-fe65d03027a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.791382] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d98818b-c2c5-4242-8897-fe65d03027a5 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.791546] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.791791] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f1554235-9a1a-4e1a-9f15-a47bfe87eddd with status ACTIVE [ 819.792114] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.794070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.794070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.794070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.794070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.794070] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.794070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.794070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.794070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.794675] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.794675] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.794675] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.794675] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.794675] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.795438] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.795438] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f1554235-9a1a-4e1a-9f15-a47bfe87eddd is going to be updated. [ 819.811923] env[70013]: INFO networking_nsxv3.common.synchronization [req-c99ba87a-7b4f-4cf2-854b-76885197bc47 req-663e3c7e-1867-4553-bb24-19df2359d775 tempest-ServersAdminNegativeTestJSON-1634392682 tempest-ServersAdminNegativeTestJSON-1634392682-project-member] Enqueued Resource ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 with Priority: HIGHEST for action security_group_members [ 819.812461] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 with Priority: HIGHEST for action security_group_members [ 819.812761] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.812906] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.812987] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.816899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.816899] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.816899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.816899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.816899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.816899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.816899] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cff04b9a-dfb1-4bca-9a12-21566cf5fe37',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.816899] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.816899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.816899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.816899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.816899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.816899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1554235-9a1a-4e1a-9f15-a47bfe87eddd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.879368] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f422a68f-f64a-4d93-9deb-289ae02aea3a: rpc.has_security_group_logging(os_id): False [ 819.911215] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.911366] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.911586] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.911647] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.911738] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.912396] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.912396] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.912396] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.912396] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.912396] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.912637] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.912637] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.912739] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.912832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.912927] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.913369] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.913369] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.913369] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.913527] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.913527] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.913589] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a is going to be updated. [ 819.980122] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.980122] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.980122] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.980122] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.980122] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.993288] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: IN_PROGRESS for 2s [ 820.240207] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d98818b-c2c5-4242-8897-fe65d03027a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.303075] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-701 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.303248] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.303378] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.303645] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.303917] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.304229] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.304468] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.304739] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.304942] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.305222] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 820.305391] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 820.305549] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 820.305882] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 820.305882] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 820.305978] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 820.306164] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 820.317757] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cff04b9a-dfb1-4bca-9a12-21566cf5fe37',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.325466] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 820.325520] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 820.325654] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 820.325875] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.326156] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-43c0cb8b-c829-4fa8-908c-527551c10fb9 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.326321] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-43c0cb8b-c829-4fa8-908c-527551c10fb9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.326428] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-43c0cb8b-c829-4fa8-908c-527551c10fb9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.326772] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-43c0cb8b-c829-4fa8-908c-527551c10fb9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.326912] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43c0cb8b-c829-4fa8-908c-527551c10fb9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.597824] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 in Status: SUCCESS [ 820.598133] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.598281] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.598527] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.598817] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.598974] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.599074] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.599266] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.599354] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.599443] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.599535] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.742213] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d98818b-c2c5-4242-8897-fe65d03027a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.821962] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cff04b9a-dfb1-4bca-9a12-21566cf5fe37',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.830171] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.830171] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.830439] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.830864] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.831091] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.831331] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 43c0cb8b-c829-4fa8-908c-527551c10fb9 not found, creating... [ 820.831995] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.832114] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.832309] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.832661] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.832906] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.833395] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.833613] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.834193] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.834193] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.834499] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.834719] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 43c0cb8b-c829-4fa8-908c-527551c10fb9 is going to be created. [ 820.858989] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.858989] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.858989] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.859287] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.859287] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.859482] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-43c0cb8b-c829-4fa8-908c-527551c10fb9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.957541] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: be9ceb9b-c3fa-402d-911f-9098a39cc84e in Status: SUCCESS [ 820.957785] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: be9ceb9b-c3fa-402d-911f-9098a39cc84e deletion is rescheduled due to dependency. [ 820.957852] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.102058] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.245217] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.245442] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.245498] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.246335] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.246335] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.246335] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 is going to be updated. [ 821.273629] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.273767] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.273859] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.274107] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.274278] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.284401] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 in Status: IN_PROGRESS for 2s [ 821.324259] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.324441] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.324515] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.324729] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.324821] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.324923] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 is going to be updated. [ 821.351663] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.351836] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.351882] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.352144] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.352298] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.361343] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 in Status: IN_PROGRESS for 2s [ 821.606613] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2: rpc.has_security_group_logging(os_id): False [ 821.624500] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.628027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.628027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.628027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.628027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.628027] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.628027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.628027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.628027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.628027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.628027] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 is going to be updated. [ 821.696404] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.696404] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.696635] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.697086] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.697086] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.714070] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 in Status: IN_PROGRESS for 2s [ 821.809210] env[70013]: INFO networking_nsxv3.common.synchronization [req-c99ba87a-7b4f-4cf2-854b-76885197bc47 req-e88e1a45-d50d-4e88-9321-04e1c34e5819 service nova] Enqueued Resource ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 with Priority: HIGHEST for action security_group_rules [ 821.809426] env[70013]: INFO networking_nsxv3.common.synchronization [req-c99ba87a-7b4f-4cf2-854b-76885197bc47 req-e88e1a45-d50d-4e88-9321-04e1c34e5819 service nova] Enqueued Resource ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 with Priority: HIGHEST for action security_group_members [ 821.809592] env[70013]: INFO networking_nsxv3.common.synchronization [req-c99ba87a-7b4f-4cf2-854b-76885197bc47 req-e88e1a45-d50d-4e88-9321-04e1c34e5819 service nova] Enqueued Resource ID: 43c0cb8b-c829-4fa8-908c-527551c10fb9 with Priority: HIGHEST for action port [ 821.809871] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 with Priority: HIGHEST for action security_group_rules [ 821.810038] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 with Priority: HIGHEST for action security_group_members [ 821.810147] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c0cb8b-c829-4fa8-908c-527551c10fb9 with Priority: HIGHEST for action port [ 821.810685] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cff04b9a-dfb1-4bca-9a12-21566cf5fe37 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.810809] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.810877] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.811091] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.811175] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cff04b9a-dfb1-4bca-9a12-21566cf5fe37',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.812410] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.812529] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.812724] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-43c0cb8b-c829-4fa8-908c-527551c10fb9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.812826] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43c0cb8b-c829-4fa8-908c-527551c10fb9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.813043] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43c0cb8b-c829-4fa8-908c-527551c10fb9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.813130] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43c0cb8b-c829-4fa8-908c-527551c10fb9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.813230] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43c0cb8b-c829-4fa8-908c-527551c10fb9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.006053] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: SUCCESS [ 822.006365] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.316028] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.316028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.316028] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43c0cb8b-c829-4fa8-908c-527551c10fb9 with status ACTIVE [ 822.316028] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.316028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.316028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.316028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.316028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.316028] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.316028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.316028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.316028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.316028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.316630] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.316630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.316630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.316630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.316630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.316785] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43c0cb8b-c829-4fa8-908c-527551c10fb9 is going to be updated. [ 822.337623] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.337777] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.337860] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.338086] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.338235] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.338407] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43c0cb8b-c829-4fa8-908c-527551c10fb9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.298501] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 in Status: SUCCESS [ 823.298782] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.298899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.299160] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.299367] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.299481] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.299562] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.301773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.301773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.301773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.301773] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d98818b-c2c5-4242-8897-fe65d03027a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.372325] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 in Status: SUCCESS [ 823.372325] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.372325] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.372325] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.372325] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.372325] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.372325] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.376911] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.376911] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.376911] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cff04b9a-dfb1-4bca-9a12-21566cf5fe37',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.727688] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 in Status: SUCCESS [ 823.727993] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.809495] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d98818b-c2c5-4242-8897-fe65d03027a5 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.809495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.809495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.809495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.809495] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.809495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.809495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.809495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.809495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.809495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.809495] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d98818b-c2c5-4242-8897-fe65d03027a5 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.809495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.809495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.809495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.809495] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.809495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.810372] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.810372] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.810372] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.810372] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.810372] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d98818b-c2c5-4242-8897-fe65d03027a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.881030] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cff04b9a-dfb1-4bca-9a12-21566cf5fe37',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.989407] env[70013]: INFO networking_nsxv3.common.synchronization [req-3ac9bd14-c8e8-48f5-b2cc-50d50b1b1414 req-7e5dcbe3-9f5c-4938-a416-e9bcf685063b tempest-ServersTestJSON-1543902807 tempest-ServersTestJSON-1543902807-project-member] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 823.992022] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 823.992022] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.992022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.992022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.992022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.992022] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.992022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.992022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.992022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.992022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.992022] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.316639] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d98818b-c2c5-4242-8897-fe65d03027a5: rpc.has_security_group_logging(os_id): False [ 824.333074] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.333074] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.333074] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.333074] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.333074] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.333074] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.333416] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.333416] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.333416] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.333526] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.333645] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.333735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.333797] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.334167] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.334167] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.334311] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.334370] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.334419] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.335715] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.335715] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.335715] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 is going to be updated. [ 824.387754] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cff04b9a-dfb1-4bca-9a12-21566cf5fe37',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.401640] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.401640] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.401640] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.401640] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.401640] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.415490] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 in Status: IN_PROGRESS for 2s [ 824.497669] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.889401] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.890034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.890034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.890034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.890034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.890299] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 is going to be updated. [ 824.916031] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.916543] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.916593] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.918328] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.918328] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.927259] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 in Status: IN_PROGRESS for 2s [ 825.004171] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.505338] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.505658] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.505658] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.505886] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.506016] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.506145] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a is going to be updated. [ 825.535332] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.535535] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.535617] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.536063] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.536063] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.544577] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: IN_PROGRESS for 2s [ 826.431104] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 in Status: SUCCESS [ 826.431875] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.937864] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 in Status: SUCCESS [ 826.938214] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.938297] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.938506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.938702] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.938829] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.938943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.939072] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.939162] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.939247] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.939356] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cff04b9a-dfb1-4bca-9a12-21566cf5fe37',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.958481] env[70013]: INFO networking_nsxv3.common.synchronization [req-e50e2e69-ec0b-46da-8467-b195ed2cc89f req-fd9ed1b7-d8d1-431e-aa85-334f6813d011 tempest-AttachVolumeNegativeTest-680083968 tempest-AttachVolumeNegativeTest-680083968-project-member] Enqueued Resource ID: f43167c6-5d75-4a22-ac5d-d671524fba53 with Priority: HIGHEST for action security_group_members [ 826.959489] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f43167c6-5d75-4a22-ac5d-d671524fba53 with Priority: HIGHEST for action security_group_members [ 826.959489] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f43167c6-5d75-4a22-ac5d-d671524fba53 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.959630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.959692] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.960023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.960322] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.960322] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.960530] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.960530] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.960701] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.960701] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f43167c6-5d75-4a22-ac5d-d671524fba53',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.271715] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-145 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.271715] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-145" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.271715] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-145" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.271715] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-145" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.271715] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.272081] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.272081] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.272294] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.273299] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.273299] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 827.273299] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 827.273299] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 827.273299] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 827.273299] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 827.273560] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 827.273560] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 827.291614] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 827.292186] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 827.292368] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 827.292557] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-145" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.292918] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-9f5cbd43-e9e7-4f35-b01e-e2e0dcbc1f5e taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.293142] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-9f5cbd43-e9e7-4f35-b01e-e2e0dcbc1f5e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.293285] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-9f5cbd43-e9e7-4f35-b01e-e2e0dcbc1f5e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.293658] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-9f5cbd43-e9e7-4f35-b01e-e2e0dcbc1f5e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.293838] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f5cbd43-e9e7-4f35-b01e-e2e0dcbc1f5e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.442963] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.442963] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.442963] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.442963] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.442963] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.442963] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.442963] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.442963] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.443450] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.443450] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.443450] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.443566] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.443566] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.443670] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.443805] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.443897] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.443982] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.444108] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.444186] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.444268] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.444366] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cff04b9a-dfb1-4bca-9a12-21566cf5fe37',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.465117] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.465117] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.465117] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.465117] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.465117] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.465117] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.465486] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.465486] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.465486] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.465486] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.465629] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f43167c6-5d75-4a22-ac5d-d671524fba53 already deleted. [ 827.465629] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.554566] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: SUCCESS [ 827.554998] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.774664] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.774868] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.775516] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.775516] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.775516] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.798064] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.798288] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.798478] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.798780] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.798932] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.799140] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 9f5cbd43-e9e7-4f35-b01e-e2e0dcbc1f5e not found, creating... [ 827.799561] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.799794] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.799915] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.800270] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.800510] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.800926] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.801057] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.801226] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.801457] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.801661] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.802087] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 9f5cbd43-e9e7-4f35-b01e-e2e0dcbc1f5e is going to be created. [ 827.821769] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.821876] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.822057] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.822373] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.822604] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.822879] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-9f5cbd43-e9e7-4f35-b01e-e2e0dcbc1f5e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.951021] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cff04b9a-dfb1-4bca-9a12-21566cf5fe37: rpc.has_security_group_logging(os_id): False [ 827.965754] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.965960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.966069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.966299] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.966399] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.966609] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.966742] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.966803] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.966981] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.967086] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.967320] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.967434] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.967495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.967668] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.967748] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.967948] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.968079] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.968159] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.968342] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.968424] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.968512] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 is going to be updated. [ 828.029513] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.029682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.029740] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.029969] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.030214] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.042796] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 in Status: IN_PROGRESS for 2s [ 828.278930] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.560736] env[70013]: INFO networking_nsxv3.common.synchronization [req-e50e2e69-ec0b-46da-8467-b195ed2cc89f req-a856bdac-ae7a-4d4e-a59b-18095517fcd2 service nova] Enqueued Resource ID: f43167c6-5d75-4a22-ac5d-d671524fba53 with Priority: HIGHEST for action security_group_rules [ 828.561880] env[70013]: INFO networking_nsxv3.common.synchronization [req-e50e2e69-ec0b-46da-8467-b195ed2cc89f req-a856bdac-ae7a-4d4e-a59b-18095517fcd2 service nova] Enqueued Resource ID: f43167c6-5d75-4a22-ac5d-d671524fba53 with Priority: HIGHEST for action security_group_members [ 828.561880] env[70013]: INFO networking_nsxv3.common.synchronization [req-e50e2e69-ec0b-46da-8467-b195ed2cc89f req-a856bdac-ae7a-4d4e-a59b-18095517fcd2 service nova] Enqueued Resource ID: 9f5cbd43-e9e7-4f35-b01e-e2e0dcbc1f5e with Priority: HIGHEST for action port [ 828.561880] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f43167c6-5d75-4a22-ac5d-d671524fba53 with Priority: HIGHEST for action security_group_rules [ 828.562104] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f43167c6-5d75-4a22-ac5d-d671524fba53 with Priority: HIGHEST for action security_group_members [ 828.562265] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5cbd43-e9e7-4f35-b01e-e2e0dcbc1f5e with Priority: HIGHEST for action port [ 828.562505] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f43167c6-5d75-4a22-ac5d-d671524fba53 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.562664] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.565144] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.565144] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.565144] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f43167c6-5d75-4a22-ac5d-d671524fba53',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.565144] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f43167c6-5d75-4a22-ac5d-d671524fba53 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.565144] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.565144] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.565144] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.565144] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.565144] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.565144] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.565756] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.565756] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.565756] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f43167c6-5d75-4a22-ac5d-d671524fba53',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.566338] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f5cbd43-e9e7-4f35-b01e-e2e0dcbc1f5e taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.566476] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f5cbd43-e9e7-4f35-b01e-e2e0dcbc1f5e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.566541] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f5cbd43-e9e7-4f35-b01e-e2e0dcbc1f5e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.566712] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f5cbd43-e9e7-4f35-b01e-e2e0dcbc1f5e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.566862] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f5cbd43-e9e7-4f35-b01e-e2e0dcbc1f5e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.781321] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.931463] env[70013]: INFO networking_nsxv3.common.synchronization [req-e267675c-7372-4310-95a1-a344fb35d41b req-ede08cbf-35e9-4ebb-8261-19ee7301b07b tempest-ServersAdminTestJSON-1183835690 tempest-ServersAdminTestJSON-1183835690-project-member] Enqueued Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_members [ 828.932150] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_members [ 828.932501] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7abade-e912-4196-b558-4a6d4ece9b29 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.932648] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.932726] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.932926] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.933135] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.933243] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.933301] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.933487] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.933909] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.933909] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.069104] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f43167c6-5d75-4a22-ac5d-d671524fba53',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.069465] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f43167c6-5d75-4a22-ac5d-d671524fba53 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.069580] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.069762] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f5cbd43-e9e7-4f35-b01e-e2e0dcbc1f5e with status ACTIVE [ 829.070273] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.070273] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.070273] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.070466] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.070466] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.073494] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.073494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.073494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.073494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.073494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.073494] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.073494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.073494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.073494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.073494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.073494] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f5cbd43-e9e7-4f35-b01e-e2e0dcbc1f5e is going to be updated. [ 829.093254] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.093452] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.093515] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.093730] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.093865] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.094013] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f5cbd43-e9e7-4f35-b01e-e2e0dcbc1f5e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.287362] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 829.287474] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 829.435895] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.534082] env[70013]: INFO networking_nsxv3.common.synchronization [req-81666243-59cf-40f2-8b78-d20857eeec27 req-35a08b4f-0cf0-4960-811b-4ea1bd60420c tempest-MigrationsAdminTest-81604366 tempest-MigrationsAdminTest-81604366-project-member] Enqueued Resource ID: 572a619a-3a59-46a6-bc09-5d754276356e with Priority: HIGHEST for action security_group_members [ 829.534735] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 572a619a-3a59-46a6-bc09-5d754276356e with Priority: HIGHEST for action security_group_members [ 829.535154] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-572a619a-3a59-46a6-bc09-5d754276356e taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.535351] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.535453] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.535710] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.535914] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.536297] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.536297] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.536297] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.536485] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.536590] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('572a619a-3a59-46a6-bc09-5d754276356e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.573731] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f43167c6-5d75-4a22-ac5d-d671524fba53',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.937936] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.991586] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-701 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.991586] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.991699] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.991875] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.992403] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.992614] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.992763] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.993049] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.993247] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.993503] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 829.993643] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 829.993811] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 829.993854] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 829.996018] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 829.996018] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 829.996018] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 830.012375] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 830.012570] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 830.012706] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 830.012886] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.013228] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-ac1e36da-5de5-4451-a9e7-39165ab5f152 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.013397] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-ac1e36da-5de5-4451-a9e7-39165ab5f152" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.013514] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-ac1e36da-5de5-4451-a9e7-39165ab5f152" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.013841] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-ac1e36da-5de5-4451-a9e7-39165ab5f152" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.014060] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac1e36da-5de5-4451-a9e7-39165ab5f152',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.018860] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.019011] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.019091] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.019293] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.033503] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 830.034734] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.035253] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 830.039559] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('572a619a-3a59-46a6-bc09-5d754276356e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.053370] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 in Status: SUCCESS [ 830.053595] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.059687] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.059835] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.059915] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.060126] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.066414] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.066994] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 830.067249] env[70013]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70013) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 830.067249] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 830.080184] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.080184] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.080184] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.080184] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.080184] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.080184] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f43167c6-5d75-4a22-ac5d-d671524fba53 is going to be created. [ 830.100232] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.100387] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.100455] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.100674] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.100831] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.107905] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.107905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.107905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.107905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.107905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.107905] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 830.116964] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f43167c6-5d75-4a22-ac5d-d671524fba53 in Status: UNINITIALIZED for 2s [ 830.172949] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.173159] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.173159] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.173635] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.173635] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.173833] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 830.269345] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.269521] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.269571] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.269782] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.270044] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.270326] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:39. [ 830.270438] env[70013]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'1197cb6b-f6f8-4e0a-8b93-e11877f2e915', '241d44e1-a518-45b5-b573-837dd908054f', '16c877e7-f731-49a5-b994-7d74c36c464b', '35104466-92f1-4e6a-9df0-55e3f828079c', '9b51e70d-5edb-4332-99e9-eb53e6015365', '9546ef83-051f-4623-9fa9-0c95fc065e91', '003a4f7e-1782-4af4-a327-5a4d7c0bee4d', 'd78f0fb5-49a9-40c7-ad7a-277209d3d53c', 'be9ceb9b-c3fa-402d-911f-9098a39cc84e', 'cff04b9a-dfb1-4bca-9a12-21566cf5fe37', 'bc1b714b-7da7-41dc-b21f-d8ad167c33d9', 'f9170b5f-e125-459e-b403-6aa7ab9296db', 'c0c24dbd-a3bb-4ba7-8bd1-0206c6519816', '06e430a7-fc6c-41b2-a61d-37124a285ded', 'aa7b798e-2025-4d46-88f3-8e44eeb87989', 'd47d19df-e406-4c01-9cf0-1110c7c55440', 'a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2', '9327e489-f357-4ab4-ad7d-eea2d96da52c', '0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd', 'e4b90d0d-893d-4d8b-9c48-77a47707807a', '5333cddc-c089-40b3-9eba-dc3f40477cac', '572a619a-3a59-46a6-bc09-5d754276356e', 'd189cef5-279a-45d3-a52a-a0fb084ee3fa', '73383895-5111-42cc-a071-b2512b2f23af', '0d98818b-c2c5-4242-8897-fe65d03027a5', '16fadac6-f5a2-4997-b67b-221b3b4e45a8', 'ff280f19-627b-45ca-afac-7d9154581e89', '0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6', '7a9726c0-7c30-4b11-81a1-9a9fcc702273', '667765ac-1a17-4f77-a3e3-a4d9d12ca600', '6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5', '86efc288-b26f-4298-9444-58202b5c40d5', 'd1b8da2b-4abc-407f-9635-008e18b53627', '12839468-1e74-4c74-abf4-73e096a46e61', 'f422a68f-f64a-4d93-9deb-289ae02aea3a', '2c2da01b-6452-4ea7-a1ca-fac9de38da7b', '48314c78-ef82-4312-9437-4a43cc3de63d', 'e99a11c8-f108-4784-aa19-9139eb46ce97', '5a7abade-e912-4196-b558-4a6d4ece9b29'} {{(pid=70013) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 830.270525] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 830.291581] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.291768] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.291869] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.292210] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.292338] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.292488] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 830.292591] env[70013]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70013) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 830.292694] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 830.353629] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.353812] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.353911] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.354215] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.355350] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.355654] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 830.355759] env[70013]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70013) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 830.355857] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 830.355948] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 830.356066] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/39 resources of Type:Security Group Rules [ 830.356167] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 with Priority: HIGH for action security_group_rules [ 830.356272] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 241d44e1-a518-45b5-b573-837dd908054f with Priority: HIGH for action security_group_rules [ 830.356365] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGH for action security_group_rules [ 830.356454] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 35104466-92f1-4e6a-9df0-55e3f828079c with Priority: HIGH for action security_group_rules [ 830.356540] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 with Priority: HIGH for action security_group_rules [ 830.356626] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9546ef83-051f-4623-9fa9-0c95fc065e91 with Priority: HIGH for action security_group_rules [ 830.356712] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 003a4f7e-1782-4af4-a327-5a4d7c0bee4d with Priority: HIGH for action security_group_rules [ 830.356841] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d78f0fb5-49a9-40c7-ad7a-277209d3d53c with Priority: HIGH for action security_group_rules [ 830.356902] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: be9ceb9b-c3fa-402d-911f-9098a39cc84e with Priority: HIGH for action security_group_rules [ 830.356955] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 with Priority: HIGH for action security_group_rules [ 830.357050] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGH for action security_group_rules [ 830.357426] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f9170b5f-e125-459e-b403-6aa7ab9296db with Priority: HIGH for action security_group_rules [ 830.357426] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 with Priority: HIGH for action security_group_rules [ 830.357426] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 06e430a7-fc6c-41b2-a61d-37124a285ded with Priority: HIGH for action security_group_rules [ 830.357426] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aa7b798e-2025-4d46-88f3-8e44eeb87989 with Priority: HIGH for action security_group_rules [ 830.357696] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGH for action security_group_rules [ 830.357696] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 with Priority: HIGH for action security_group_rules [ 830.357696] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9327e489-f357-4ab4-ad7d-eea2d96da52c with Priority: HIGH for action security_group_rules [ 830.357852] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd with Priority: HIGH for action security_group_rules [ 830.357852] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e4b90d0d-893d-4d8b-9c48-77a47707807a with Priority: HIGH for action security_group_rules [ 830.357956] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.441030] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.441030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.441030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.441283] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.441379] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.441501] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 is going to be updated. [ 830.467813] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.467813] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.467945] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.468127] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.468281] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.476894] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: IN_PROGRESS for 2s [ 830.517801] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.518086] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.518179] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.518405] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.518542] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.518748] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port ac1e36da-5de5-4451-a9e7-39165ab5f152 not found, creating... [ 830.518950] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.519120] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.519318] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.519453] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.519626] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.519871] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.520033] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.520150] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.520358] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.520490] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.520626] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: ac1e36da-5de5-4451-a9e7-39165ab5f152 is going to be created. [ 830.538922] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.539117] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.539247] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.539493] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.539713] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.539936] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-ac1e36da-5de5-4451-a9e7-39165ab5f152" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.541015] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('572a619a-3a59-46a6-bc09-5d754276356e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.044191] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.044360] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.044424] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.044642] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.044733] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.044832] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 572a619a-3a59-46a6-bc09-5d754276356e is going to be updated. [ 831.069863] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.069991] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.070073] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.070284] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.070415] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.078726] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 572a619a-3a59-46a6-bc09-5d754276356e in Status: IN_PROGRESS for 2s [ 831.365606] env[70013]: INFO networking_nsxv3.common.synchronization [req-81666243-59cf-40f2-8b78-d20857eeec27 req-80a93145-a430-4b42-993f-94b07c58f69e service nova] Enqueued Resource ID: 572a619a-3a59-46a6-bc09-5d754276356e with Priority: HIGHEST for action security_group_rules [ 831.365606] env[70013]: INFO networking_nsxv3.common.synchronization [req-81666243-59cf-40f2-8b78-d20857eeec27 req-80a93145-a430-4b42-993f-94b07c58f69e service nova] Enqueued Resource ID: 572a619a-3a59-46a6-bc09-5d754276356e with Priority: HIGHEST for action security_group_members [ 831.365606] env[70013]: INFO networking_nsxv3.common.synchronization [req-81666243-59cf-40f2-8b78-d20857eeec27 req-80a93145-a430-4b42-993f-94b07c58f69e service nova] Enqueued Resource ID: ac1e36da-5de5-4451-a9e7-39165ab5f152 with Priority: HIGHEST for action port [ 831.370269] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 572a619a-3a59-46a6-bc09-5d754276356e with Priority: HIGHEST for action security_group_rules [ 831.370269] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 572a619a-3a59-46a6-bc09-5d754276356e with Priority: HIGHEST for action security_group_members [ 831.370269] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac1e36da-5de5-4451-a9e7-39165ab5f152 with Priority: HIGHEST for action port [ 831.370269] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 with Priority: HIGH for action security_group_rules [ 831.370269] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGH for action security_group_rules [ 831.370269] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 003a4f7e-1782-4af4-a327-5a4d7c0bee4d with Priority: HIGH for action security_group_rules [ 831.370269] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7b798e-2025-4d46-88f3-8e44eeb87989 with Priority: HIGH for action security_group_rules [ 831.370269] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4b90d0d-893d-4d8b-9c48-77a47707807a with Priority: HIGH for action security_group_rules [ 831.370770] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd with Priority: HIGH for action security_group_rules [ 831.370770] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9327e489-f357-4ab4-ad7d-eea2d96da52c with Priority: HIGH for action security_group_rules [ 831.370770] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 with Priority: HIGH for action security_group_rules [ 831.370770] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e430a7-fc6c-41b2-a61d-37124a285ded with Priority: HIGH for action security_group_rules [ 831.370770] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGH for action security_group_rules [ 831.370770] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 with Priority: HIGH for action security_group_rules [ 831.371309] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9170b5f-e125-459e-b403-6aa7ab9296db with Priority: HIGH for action security_group_rules [ 831.371309] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGH for action security_group_rules [ 831.371309] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 with Priority: HIGH for action security_group_rules [ 831.371309] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9ceb9b-c3fa-402d-911f-9098a39cc84e with Priority: HIGH for action security_group_rules [ 831.371309] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9546ef83-051f-4623-9fa9-0c95fc065e91 with Priority: HIGH for action security_group_rules [ 831.371790] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d78f0fb5-49a9-40c7-ad7a-277209d3d53c with Priority: HIGH for action security_group_rules [ 831.371790] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 with Priority: HIGH for action security_group_rules [ 831.371790] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 241d44e1-a518-45b5-b573-837dd908054f with Priority: HIGH for action security_group_rules [ 831.371790] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35104466-92f1-4e6a-9df0-55e3f828079c with Priority: HIGH for action security_group_rules [ 831.372491] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-572a619a-3a59-46a6-bc09-5d754276356e taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.372491] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.372656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.373035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.374034] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('572a619a-3a59-46a6-bc09-5d754276356e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.374186] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-572a619a-3a59-46a6-bc09-5d754276356e taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.374294] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.374800] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac1e36da-5de5-4451-a9e7-39165ab5f152 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.374920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac1e36da-5de5-4451-a9e7-39165ab5f152" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.374989] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac1e36da-5de5-4451-a9e7-39165ab5f152" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.375202] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac1e36da-5de5-4451-a9e7-39165ab5f152" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.375294] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac1e36da-5de5-4451-a9e7-39165ab5f152',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.376361] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1197cb6b-f6f8-4e0a-8b93-e11877f2e915 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.376543] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.376645] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.376836] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.376914] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1197cb6b-f6f8-4e0a-8b93-e11877f2e915',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.377830] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.377982] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.378047] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.378180] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.378258] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.379777] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-003a4f7e-1782-4af4-a327-5a4d7c0bee4d taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.379892] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.379950] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.380139] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.380272] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('003a4f7e-1782-4af4-a327-5a4d7c0bee4d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.381484] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa7b798e-2025-4d46-88f3-8e44eeb87989 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.381644] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.381730] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.381893] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.381963] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa7b798e-2025-4d46-88f3-8e44eeb87989',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.383292] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4b90d0d-893d-4d8b-9c48-77a47707807a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.383511] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.383583] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.383796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.383931] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4b90d0d-893d-4d8b-9c48-77a47707807a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.385278] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.385388] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.385458] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.385730] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.385819] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.386795] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9327e489-f357-4ab4-ad7d-eea2d96da52c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.386906] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.386993] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.387214] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.387325] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9327e489-f357-4ab4-ad7d-eea2d96da52c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.388188] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.388297] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.388370] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.388521] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.388593] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.389392] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06e430a7-fc6c-41b2-a61d-37124a285ded taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.390835] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.390909] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.391122] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.391189] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06e430a7-fc6c-41b2-a61d-37124a285ded',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.391387] env[70013]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 831.392113] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.392214] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.392277] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.392429] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.392502] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.393617] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.393749] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.393749] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.393906] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.394033] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0c24dbd-a3bb-4ba7-8bd1-0206c6519816',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.394861] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9170b5f-e125-459e-b403-6aa7ab9296db taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.394955] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.395035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.395188] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.395261] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9170b5f-e125-459e-b403-6aa7ab9296db',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.396080] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.396193] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.396258] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.396411] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.396480] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.397375] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cff04b9a-dfb1-4bca-9a12-21566cf5fe37 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.397487] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.397552] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.397689] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.397764] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cff04b9a-dfb1-4bca-9a12-21566cf5fe37',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.398542] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-be9ceb9b-c3fa-402d-911f-9098a39cc84e taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.398650] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.398702] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.398848] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.398918] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('be9ceb9b-c3fa-402d-911f-9098a39cc84e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.399852] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9546ef83-051f-4623-9fa9-0c95fc065e91 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.400191] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.400261] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.400413] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.400482] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9546ef83-051f-4623-9fa9-0c95fc065e91',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.401345] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d78f0fb5-49a9-40c7-ad7a-277209d3d53c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.401487] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.401588] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.401694] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.401763] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d78f0fb5-49a9-40c7-ad7a-277209d3d53c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.402594] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b51e70d-5edb-4332-99e9-eb53e6015365 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.402704] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.402778] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.402980] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.403236] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.406327] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-241d44e1-a518-45b5-b573-837dd908054f taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.406470] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.406540] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.406737] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.407024] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('241d44e1-a518-45b5-b573-837dd908054f',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.407112] env[70013]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 831.408033] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35104466-92f1-4e6a-9df0-55e3f828079c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.408125] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.408201] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.408341] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.408411] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35104466-92f1-4e6a-9df0-55e3f828079c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.416353] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac1e36da-5de5-4451-a9e7-39165ab5f152 with status ACTIVE [ 831.416640] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.416736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.416736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.416903] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.416990] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.417175] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.417270] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.417329] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.417474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.417849] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.417849] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.417849] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.417849] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.418027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.418061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.418189] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac1e36da-5de5-4451-a9e7-39165ab5f152 is going to be updated. [ 831.450418] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.450418] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.450418] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.450418] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.450418] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.450418] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac1e36da-5de5-4451-a9e7-39165ab5f152" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.911758] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-572a619a-3a59-46a6-bc09-5d754276356e taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.911909] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.915479] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1197cb6b-f6f8-4e0a-8b93-e11877f2e915 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.915639] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.915704] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.915891] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.916062] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.916165] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.916221] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.916365] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.916556] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.916556] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.916688] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1197cb6b-f6f8-4e0a-8b93-e11877f2e915',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.947404] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.947594] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.947672] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.948073] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.948200] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.948298] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.948363] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.948891] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.948891] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.948891] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.948891] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.953258] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.953773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.953773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.953773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.953982] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.953982] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.954085] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.954231] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.954307] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.954422] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.954502] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cff04b9a-dfb1-4bca-9a12-21566cf5fe37',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.955501] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-35104466-92f1-4e6a-9df0-55e3f828079c taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.955623] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.955688] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.955844] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.956654] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.956654] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.956654] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.956654] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.957332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.958105] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.958105] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('35104466-92f1-4e6a-9df0-55e3f828079c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.960295] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.960414] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.960486] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.960659] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.960885] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.960989] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.961062] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.961211] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.961577] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.961577] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.961577] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.962336] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.962443] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.962510] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.962660] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.962798] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.962885] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.962944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.963263] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.963263] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.963263] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.963410] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.973435] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b51e70d-5edb-4332-99e9-eb53e6015365 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.973591] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.973591] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.973804] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.973965] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.974080] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.974162] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.974317] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.974401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.974484] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.974565] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.976368] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.976489] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.976560] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.976741] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.976888] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.976981] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.977057] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.977203] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.977284] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.977366] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.977448] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.007733] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.007932] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.007932] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.008167] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.010189] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.010328] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.011849] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.012018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.021267] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.021427] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.022402] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.022523] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.023271] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.023401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.024880] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.024880] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.025039] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.025039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.025729] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.025839] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.026598] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.026713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.027476] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.027590] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.028219] env[70013]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 832.028644] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.028766] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.029740] env[70013]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 832.030160] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.030276] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4b90d0d-893d-4d8b-9c48-77a47707807a is going to be deleted. [ 832.031221] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.031467] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.046547] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.046723] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06e430a7-fc6c-41b2-a61d-37124a285ded is going to be deleted. [ 832.047735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.047952] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.065075] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.065075] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d78f0fb5-49a9-40c7-ad7a-277209d3d53c is going to be deleted. [ 832.065075] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.065332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.082414] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.082585] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: be9ceb9b-c3fa-402d-911f-9098a39cc84e is going to be deleted. [ 832.083523] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.083738] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.085201] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.085304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.100724] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.101012] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.109559] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.109559] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.119070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.119191] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b is going to be deleted. [ 832.119932] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.120194] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.131811] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f43167c6-5d75-4a22-ac5d-d671524fba53 in Status: SUCCESS [ 832.132377] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.132611] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.132821] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.133010] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.133131] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.133197] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.133350] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.133433] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.133513] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.133603] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f43167c6-5d75-4a22-ac5d-d671524fba53',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.149434] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.149588] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 241d44e1-a518-45b5-b573-837dd908054f is going to be deleted. [ 832.150542] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.150768] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.159231] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.159391] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.191056] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.191056] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9546ef83-051f-4623-9fa9-0c95fc065e91 is going to be deleted. [ 832.191621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.191905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.196940] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.197097] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.248400] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.248588] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9170b5f-e125-459e-b403-6aa7ab9296db is going to be deleted. [ 832.249698] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.250028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.307084] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.307225] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.311706] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.311864] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.313576] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.313797] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9327e489-f357-4ab4-ad7d-eea2d96da52c is going to be deleted. [ 832.314817] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.315047] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.384054] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.384054] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.419034] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1197cb6b-f6f8-4e0a-8b93-e11877f2e915',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.583235] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.583358] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.584104] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.584212] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.584277] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.584500] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.584645] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.584736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.584795] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.584940] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.585032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.585114] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.585250] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.585334] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.585592] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.585592] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.585689] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.585737] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.585771] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.587446] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.587446] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.587446] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.587446] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cff04b9a-dfb1-4bca-9a12-21566cf5fe37',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.587446] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.587446] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.587446] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.587446] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.587446] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.587446] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.588480] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.588480] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.588480] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.588480] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.588480] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.588480] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.588480] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.588480] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.588480] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.588480] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.588480] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.589038] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.589038] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.589038] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.589038] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.589500] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.593021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.593021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.593021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.593021] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.593021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.593021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.593021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.593021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.593021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.593021] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.593021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.593021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.593021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.593021] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.593021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.593021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.593021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.593021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.594309] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.594309] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.594309] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('35104466-92f1-4e6a-9df0-55e3f828079c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.594309] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.594309] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b51e70d-5edb-4332-99e9-eb53e6015365 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.594669] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.594669] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.594669] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.594973] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.594973] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.594973] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.594973] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.595203] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.595203] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.595315] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b51e70d-5edb-4332-99e9-eb53e6015365 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.595381] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.595381] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.596033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.596033] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.596033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.596033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.596033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.596033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.596033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.596445] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.596703] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.598127] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.598188] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 003a4f7e-1782-4af4-a327-5a4d7c0bee4d is going to be deleted. [ 832.601047] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cff04b9a-dfb1-4bca-9a12-21566cf5fe37: rpc.has_security_group_logging(os_id): False [ 832.602130] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.602304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.613191] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: SUCCESS [ 832.613390] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.634249] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.634249] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.636100] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.636228] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0c24dbd-a3bb-4ba7-8bd1-0206c6519816 is going to be deleted. [ 832.637167] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f43167c6-5d75-4a22-ac5d-d671524fba53',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.637885] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.638112] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.660542] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.660542] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa7b798e-2025-4d46-88f3-8e44eeb87989 is going to be deleted. [ 832.661289] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.661502] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.661593] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.661721] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4b90d0d-893d-4d8b-9c48-77a47707807a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.662591] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.662712] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.662760] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.662928] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.663059] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.663234] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-003a4f7e-1782-4af4-a327-5a4d7c0bee4d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.663401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.663563] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.663652] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.663771] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06e430a7-fc6c-41b2-a61d-37124a285ded" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.664296] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.664476] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.664565] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.664684] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d78f0fb5-49a9-40c7-ad7a-277209d3d53c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.664853] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.665007] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.665092] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.665206] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-be9ceb9b-c3fa-402d-911f-9098a39cc84e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.665343] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.665486] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.665560] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.665667] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.666093] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.666256] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.666376] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.666491] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-241d44e1-a518-45b5-b573-837dd908054f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.666607] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.666743] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.666816] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.666924] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9546ef83-051f-4623-9fa9-0c95fc065e91" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.667079] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.667213] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.667287] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.667395] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9170b5f-e125-459e-b403-6aa7ab9296db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.667502] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.667658] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.667731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.667827] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9327e489-f357-4ab4-ad7d-eea2d96da52c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.667967] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.668123] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.702639] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.702639] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.703369] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.703761] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.704070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.704163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.704376] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.704461] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.704700] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.704803] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.704867] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.705028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.705115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.705320] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.705464] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.705464] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.705599] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.705652] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.705738] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 is going to be updated. [ 832.707257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.707257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.707257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.707257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0c24dbd-a3bb-4ba7-8bd1-0206c6519816" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.779260] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.779449] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.779449] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.779635] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.779728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.779848] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa7b798e-2025-4d46-88f3-8e44eeb87989" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.810394] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.810394] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.810394] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.810394] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.810394] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.839600] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 in Status: IN_PROGRESS for 2s [ 832.921551] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1197cb6b-f6f8-4e0a-8b93-e11877f2e915: rpc.has_security_group_logging(os_id): False [ 832.946098] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.946301] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.946350] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.946550] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.968368] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.968951] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.969189] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.969294] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.969537] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.969625] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.969720] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 is going to be updated. [ 833.020105] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.020366] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.020366] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.020539] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.020689] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.040240] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 in Status: IN_PROGRESS for 2s [ 833.088236] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 572a619a-3a59-46a6-bc09-5d754276356e in Status: SUCCESS [ 833.088528] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.088739] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.088981] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.089302] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.089498] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.089569] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.089734] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.089816] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.089961] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('572a619a-3a59-46a6-bc09-5d754276356e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.100478] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc1b714b-7da7-41dc-b21f-d8ad167c33d9: rpc.has_security_group_logging(os_id): False [ 833.103205] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b51e70d-5edb-4332-99e9-eb53e6015365: rpc.has_security_group_logging(os_id): False [ 833.104185] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd: rpc.has_security_group_logging(os_id): False [ 833.105058] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d47d19df-e406-4c01-9cf0-1110c7c55440: rpc.has_security_group_logging(os_id): False [ 833.105837] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 35104466-92f1-4e6a-9df0-55e3f828079c: rpc.has_security_group_logging(os_id): False [ 833.106658] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2: rpc.has_security_group_logging(os_id): False [ 833.140096] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.140311] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.140413] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.140819] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.143652] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.143832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.144166] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f43167c6-5d75-4a22-ac5d-d671524fba53: rpc.has_security_group_logging(os_id): False [ 833.157257] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.157257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.158203] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.158314] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.158964] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.159310] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.160293] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.160402] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.265772] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.265772] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.265772] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.265772] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.265772] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.265772] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.265772] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.265772] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.265772] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.265772] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.265772] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.265772] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.265772] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.266556] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.266556] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.266556] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.266556] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.266556] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.266556] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d47d19df-e406-4c01-9cf0-1110c7c55440 is going to be updated. [ 833.266556] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.266556] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.307676] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.308227] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.308227] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.308227] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.308461] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.308540] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.308639] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 is going to be updated. [ 833.316570] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.316946] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.340663] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.340663] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.340663] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.340663] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.340663] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.340663] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.341190] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35104466-92f1-4e6a-9df0-55e3f828079c is going to be updated. [ 833.341977] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.342434] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.378940] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.379249] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.379410] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.379547] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.379661] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.379772] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.380041] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.380225] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.380296] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.380586] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.380586] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.380792] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.380890] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.380941] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.381082] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.381167] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.381300] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 is going to be updated. [ 833.383890] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.384941] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.412350] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.412866] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.421701] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.421701] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.421701] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.421701] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.421701] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.421701] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.421701] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd is going to be updated. [ 833.424764] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.426069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.426069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.426069] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.426069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.426069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.426069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.426069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.426069] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f43167c6-5d75-4a22-ac5d-d671524fba53 is going to be created. [ 833.427926] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.428168] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.435801] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.439019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.460366] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.460366] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.483287] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.483599] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.484543] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.484543] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.484543] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.484543] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.484543] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.484543] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.484543] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.485175] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.485175] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.485175] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.485175] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.485175] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.485175] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.485175] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.485696] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 is going to be updated. [ 833.486658] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.486733] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.486905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.487862] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.488081] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.488256] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.489330] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.489534] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.490875] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.513442] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.513920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.513920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.514446] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.514636] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.518233] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35104466-92f1-4e6a-9df0-55e3f828079c in Status: IN_PROGRESS for 2s [ 833.522878] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 in Status: IN_PROGRESS for 2s [ 833.523610] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: IN_PROGRESS for 2s [ 833.549811] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.553028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.553028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.553028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.553028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.557909] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.557909] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.558125] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.558293] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.558354] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.577588] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 in Status: IN_PROGRESS for 2s [ 833.578542] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f43167c6-5d75-4a22-ac5d-d671524fba53 in Status: IN_PROGRESS for 2s [ 833.592180] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('572a619a-3a59-46a6-bc09-5d754276356e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.608460] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd in Status: IN_PROGRESS for 2s [ 833.670869] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.671029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.671154] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.671429] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.672082] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.712918] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: IN_PROGRESS for 2s [ 834.097524] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('572a619a-3a59-46a6-bc09-5d754276356e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.605486] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.605785] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.605785] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.605925] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.606027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.606132] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 572a619a-3a59-46a6-bc09-5d754276356e is going to be updated. [ 834.633532] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.633708] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.633772] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.633961] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.634118] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.645100] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 572a619a-3a59-46a6-bc09-5d754276356e in Status: IN_PROGRESS for 2s [ 834.854712] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 in Status: SUCCESS [ 834.854822] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.056070] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 in Status: SUCCESS [ 835.056476] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.534980] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35104466-92f1-4e6a-9df0-55e3f828079c in Status: SUCCESS [ 835.535280] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.536220] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 in Status: SUCCESS [ 835.536414] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.537187] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: SUCCESS [ 835.537449] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.598802] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f43167c6-5d75-4a22-ac5d-d671524fba53 in Status: SUCCESS [ 835.599098] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.601412] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 in Status: SUCCESS [ 835.601605] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.620784] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd in Status: SUCCESS [ 835.621117] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.728191] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: SUCCESS [ 835.728337] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.374459] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 836.374573] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 836.538383] env[70013]: INFO networking_nsxv3.common.synchronization [req-62e18d13-1077-4165-9d6e-89b6eb072914 req-6a68927d-0900-4533-92c8-22109a6e7160 tempest-ListServersNegativeTestJSON-1728183933 tempest-ListServersNegativeTestJSON-1728183933-project-member] Enqueued Resource ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 with Priority: HIGHEST for action security_group_members [ 836.538932] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 with Priority: HIGHEST for action security_group_members [ 836.539271] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.539405] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.539491] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.539744] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.539901] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.541316] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.542692] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.542692] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.542692] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.542692] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.653915] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 572a619a-3a59-46a6-bc09-5d754276356e in Status: SUCCESS [ 836.654206] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.654395] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.654641] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.654874] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.655017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.655084] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.655246] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.655344] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.655454] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.655551] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('572a619a-3a59-46a6-bc09-5d754276356e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.869015] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-392 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.869259] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-392" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.869390] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-392" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.869718] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-392" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.869989] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.870193] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.870317] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.870534] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.870682] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.870897] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 836.871022] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 836.871136] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 836.871247] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 836.871356] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 836.871461] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 836.871597] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 836.890447] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 836.890616] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 836.890759] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 836.890945] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-392" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.891288] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-a4cb005b-e1cb-4efe-9272-a7adbf42d5bc taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.891467] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-a4cb005b-e1cb-4efe-9272-a7adbf42d5bc" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.891591] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-a4cb005b-e1cb-4efe-9272-a7adbf42d5bc" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.891917] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-a4cb005b-e1cb-4efe-9272-a7adbf42d5bc" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.892132] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4cb005b-e1cb-4efe-9272-a7adbf42d5bc',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.047780] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.047942] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.048093] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.049170] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.049170] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.049170] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.049170] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.049170] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.049170] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.049170] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.049170] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 already deleted. [ 837.049170] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.157906] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-572a619a-3a59-46a6-bc09-5d754276356e taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.158082] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.158160] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.158415] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.158645] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.159178] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.159324] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.159618] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.159675] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.159755] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.159901] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-572a619a-3a59-46a6-bc09-5d754276356e taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.160064] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.160064] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.160222] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.160355] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.160466] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.160562] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.160713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.161249] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.161249] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.161249] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('572a619a-3a59-46a6-bc09-5d754276356e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.397056] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.397056] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.397056] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.397953] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.397953] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.397953] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port a4cb005b-e1cb-4efe-9272-a7adbf42d5bc not found, creating... [ 837.397953] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.398197] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.398243] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.398481] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.398621] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.398906] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.399079] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.399195] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.399399] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.399534] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.399670] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: a4cb005b-e1cb-4efe-9272-a7adbf42d5bc is going to be created. [ 837.419685] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.419883] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.420036] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.420341] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.420577] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.420794] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-a4cb005b-e1cb-4efe-9272-a7adbf42d5bc" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.663739] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 572a619a-3a59-46a6-bc09-5d754276356e: rpc.has_security_group_logging(os_id): False [ 837.683448] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.684064] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.684064] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.684064] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.702410] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.702641] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.702923] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.702923] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.703061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.703122] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.703379] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.703493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.703523] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.703746] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.703746] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.703949] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.704098] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.704139] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.704281] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.704394] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.704478] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 572a619a-3a59-46a6-bc09-5d754276356e is going to be updated. [ 837.740330] env[70013]: INFO networking_nsxv3.common.synchronization [req-dcecbce0-59b1-48cc-9bcb-69e1ee765806 req-356af7fc-2da4-4aeb-99a2-ccfcb023dc17 tempest-ServersAdminNegativeTestJSON-1634392682 tempest-ServersAdminNegativeTestJSON-1634392682-project-member] Enqueued Resource ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 with Priority: HIGHEST for action security_group_members [ 837.740896] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 with Priority: HIGHEST for action security_group_members [ 837.741267] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.741398] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.741473] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.741677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.741828] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.741927] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.741992] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.742185] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.742274] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.742385] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cff04b9a-dfb1-4bca-9a12-21566cf5fe37',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.760383] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.760547] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.760612] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.760824] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.760967] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.775714] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 572a619a-3a59-46a6-bc09-5d754276356e in Status: IN_PROGRESS for 2s [ 838.138365] env[70013]: INFO networking_nsxv3.common.synchronization [req-62e18d13-1077-4165-9d6e-89b6eb072914 req-885700c3-3a73-4806-a07e-93232ce9e5d7 service nova] Enqueued Resource ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 with Priority: HIGHEST for action security_group_rules [ 838.138365] env[70013]: INFO networking_nsxv3.common.synchronization [req-62e18d13-1077-4165-9d6e-89b6eb072914 req-885700c3-3a73-4806-a07e-93232ce9e5d7 service nova] Enqueued Resource ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 with Priority: HIGHEST for action security_group_members [ 838.138365] env[70013]: INFO networking_nsxv3.common.synchronization [req-62e18d13-1077-4165-9d6e-89b6eb072914 req-885700c3-3a73-4806-a07e-93232ce9e5d7 service nova] Enqueued Resource ID: a4cb005b-e1cb-4efe-9272-a7adbf42d5bc with Priority: HIGHEST for action port [ 838.138605] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 with Priority: HIGHEST for action security_group_rules [ 838.138823] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 with Priority: HIGHEST for action security_group_members [ 838.138823] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4cb005b-e1cb-4efe-9272-a7adbf42d5bc with Priority: HIGHEST for action port [ 838.139540] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.139540] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.139540] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.139719] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.139770] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.143452] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.143452] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.143452] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.143452] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.143629] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.143679] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.143754] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.143902] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.144927] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.144927] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.145697] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4cb005b-e1cb-4efe-9272-a7adbf42d5bc taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.145823] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4cb005b-e1cb-4efe-9272-a7adbf42d5bc" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.145823] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4cb005b-e1cb-4efe-9272-a7adbf42d5bc" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.146190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4cb005b-e1cb-4efe-9272-a7adbf42d5bc" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.146190] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4cb005b-e1cb-4efe-9272-a7adbf42d5bc',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.245129] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cff04b9a-dfb1-4bca-9a12-21566cf5fe37',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.647921] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.648074] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.648269] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.649188] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a4cb005b-e1cb-4efe-9272-a7adbf42d5bc with status ACTIVE [ 838.649371] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.649606] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.649606] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.649751] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.649837] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.650022] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.650119] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.650183] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.650349] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.650427] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.650611] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.650703] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.650763] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.650905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.650978] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.651889] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a4cb005b-e1cb-4efe-9272-a7adbf42d5bc is going to be updated. [ 838.684593] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.684923] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.684923] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.685274] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.685426] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.685591] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4cb005b-e1cb-4efe-9272-a7adbf42d5bc" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.748144] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cff04b9a-dfb1-4bca-9a12-21566cf5fe37',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.153932] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.256503] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.256798] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.256798] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.256924] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.257087] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.257149] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 is going to be updated. [ 839.259162] env[70013]: INFO networking_nsxv3.common.synchronization [req-62e18d13-1077-4165-9d6e-89b6eb072914 req-1bdab438-3535-44c9-9d8d-aa84cfe9e8a1 tempest-ListServersNegativeTestJSON-1728183933 tempest-ListServersNegativeTestJSON-1728183933-project-member] Enqueued Resource ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 with Priority: HIGHEST for action security_group_members [ 839.259679] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 with Priority: HIGHEST for action security_group_members [ 839.262351] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.262351] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.290624] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.290624] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.290624] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.290624] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.290786] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.301640] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 in Status: IN_PROGRESS for 2s [ 839.658969] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.658969] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.658969] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.658969] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.658969] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.658969] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 is going to be created. [ 839.672636] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-392 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.672829] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-392" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.672954] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-392" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.673694] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-392" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.673694] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.673807] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.673852] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.674391] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.674441] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.674645] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 839.674761] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 839.675451] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 839.675451] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 839.675451] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 839.675451] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 839.675451] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 839.769774] env[70013]: INFO networking_nsxv3.common.synchronization [req-84b47043-8591-4bb1-a621-67ff3b2d6710 req-ccf19590-1416-4a8a-a0b3-e0319d5c4176 tempest-ImagesOneServerNegativeTestJSON-165560685 tempest-ImagesOneServerNegativeTestJSON-165560685-project-member] Enqueued Resource ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 with Priority: HIGHEST for action security_group_members [ 839.770449] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 with Priority: HIGHEST for action security_group_members [ 839.770915] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d98818b-c2c5-4242-8897-fe65d03027a5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.771230] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.771302] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.771505] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.771661] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.771801] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.771855] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.771969] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.772054] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.772210] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d98818b-c2c5-4242-8897-fe65d03027a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.788217] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 839.788432] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.113 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 839.788603] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 839.788817] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-392" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.789211] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-e4568496-25b6-4661-bb65-1608ffd75212 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.789522] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-e4568496-25b6-4661-bb65-1608ffd75212" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.789717] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-e4568496-25b6-4661-bb65-1608ffd75212" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.789962] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-e4568496-25b6-4661-bb65-1608ffd75212" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.790207] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4568496-25b6-4661-bb65-1608ffd75212',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.795520] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.795520] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.795520] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.795520] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.795520] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.796146] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 572a619a-3a59-46a6-bc09-5d754276356e in Status: SUCCESS [ 839.796346] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.810589] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 in Status: UNINITIALIZED for 2s [ 840.278122] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.278122] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.278122] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.278122] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.297653] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.298692] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.298813] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.299143] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.299325] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.299503] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port e4568496-25b6-4661-bb65-1608ffd75212 not found, creating... [ 840.299802] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.299998] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.300157] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.300395] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.300544] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.300840] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.301012] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.301139] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.301352] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.301503] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.301646] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: e4568496-25b6-4661-bb65-1608ffd75212 is going to be created. [ 840.308762] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.308762] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.308762] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.309079] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.309272] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.309351] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.309469] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 is going to be updated. [ 840.332650] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.332888] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.333037] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.333406] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.333661] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.333936] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-e4568496-25b6-4661-bb65-1608ffd75212" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.346114] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.346114] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.346114] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.346114] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.346114] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.355800] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 in Status: IN_PROGRESS for 2s [ 840.949833] env[70013]: INFO networking_nsxv3.common.synchronization [req-62e18d13-1077-4165-9d6e-89b6eb072914 req-070dc7ce-3bdd-4543-ac3c-76d4a2eef425 service nova] Enqueued Resource ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 with Priority: HIGHEST for action security_group_rules [ 840.950104] env[70013]: INFO networking_nsxv3.common.synchronization [req-62e18d13-1077-4165-9d6e-89b6eb072914 req-070dc7ce-3bdd-4543-ac3c-76d4a2eef425 service nova] Enqueued Resource ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 with Priority: HIGHEST for action security_group_members [ 840.950184] env[70013]: INFO networking_nsxv3.common.synchronization [req-62e18d13-1077-4165-9d6e-89b6eb072914 req-070dc7ce-3bdd-4543-ac3c-76d4a2eef425 service nova] Enqueued Resource ID: e4568496-25b6-4661-bb65-1608ffd75212 with Priority: HIGHEST for action port [ 840.950416] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 with Priority: HIGHEST for action security_group_rules [ 840.950545] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 with Priority: HIGHEST for action security_group_members [ 840.950642] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4568496-25b6-4661-bb65-1608ffd75212 with Priority: HIGHEST for action port [ 840.951284] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.951380] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.951595] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.951656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.954965] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4568496-25b6-4661-bb65-1608ffd75212 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.954965] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4568496-25b6-4661-bb65-1608ffd75212" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.954965] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4568496-25b6-4661-bb65-1608ffd75212" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.954965] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4568496-25b6-4661-bb65-1608ffd75212" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.954965] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4568496-25b6-4661-bb65-1608ffd75212',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.311237] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 in Status: SUCCESS [ 841.311454] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.457841] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e4568496-25b6-4661-bb65-1608ffd75212 with status ACTIVE [ 841.457841] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.458025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.458056] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.458278] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.458415] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.458550] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.458645] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.458708] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.458866] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.460761] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.460761] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.460761] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.460761] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.460761] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.460761] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.460761] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e4568496-25b6-4661-bb65-1608ffd75212 is going to be updated. [ 841.482943] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.483112] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.483191] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.483471] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.483582] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.483743] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4568496-25b6-4661-bb65-1608ffd75212" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.820431] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 in Status: SUCCESS [ 841.820646] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.821089] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.821305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.821493] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.821607] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.821671] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.821823] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.821903] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.821986] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.822112] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.822855] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.823096] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.823303] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.823440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.823518] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.823688] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.823794] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.823900] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.326399] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.327538] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.327607] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.365197] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 in Status: SUCCESS [ 842.365197] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 deletion is rescheduled due to dependency. [ 842.365351] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.828589] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.332894] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.333217] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.333217] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.333426] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.333520] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.333623] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 is going to be updated. [ 843.359489] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.359550] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.359576] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.359790] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.360111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.370721] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 in Status: IN_PROGRESS for 2s [ 844.069422] env[70013]: INFO networking_nsxv3.common.synchronization [req-3b3e825c-71b1-4944-b679-2645c48ce2c0 req-da509d0a-c2f8-4fd0-98e2-25b258678917 tempest-VolumesAssistedSnapshotsTest-996933272 tempest-VolumesAssistedSnapshotsTest-996933272-project-member] Enqueued Resource ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd with Priority: HIGHEST for action security_group_members [ 844.070099] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd with Priority: HIGHEST for action security_group_members [ 844.070491] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.070584] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.070626] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.070828] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.070978] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.071345] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.071462] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.071643] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.071755] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.071882] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.576927] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.577319] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.577319] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.577410] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.577465] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.577666] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.577752] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.577816] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.578073] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.578073] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.578505] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd is going to be updated. [ 844.603889] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.604058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.604132] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.604360] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.604526] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.614192] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd in Status: IN_PROGRESS for 2s [ 845.384204] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 in Status: SUCCESS [ 845.384619] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.384902] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.385240] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.388215] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.388215] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.388215] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.388215] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.388215] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.388215] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.889997] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.393090] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.624834] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd in Status: SUCCESS [ 846.625110] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd deletion is rescheduled due to dependency. [ 846.625230] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.897594] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.897930] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.897930] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.898406] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.898406] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.898406] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 is going to be updated. [ 846.926697] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.926849] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.926919] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.927505] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.927709] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.936872] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 in Status: IN_PROGRESS for 2s [ 848.275642] env[70013]: INFO networking_nsxv3.common.synchronization [req-b27d42c4-bc8f-41a2-a919-773374328e54 req-3c0ed2a7-fe28-4915-936b-97ad35096def tempest-AttachVolumeTestJSON-972861423 tempest-AttachVolumeTestJSON-972861423-project-member] Enqueued Resource ID: 5333cddc-c089-40b3-9eba-dc3f40477cac with Priority: HIGHEST for action security_group_members [ 848.276017] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5333cddc-c089-40b3-9eba-dc3f40477cac with Priority: HIGHEST for action security_group_members [ 848.276366] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5333cddc-c089-40b3-9eba-dc3f40477cac taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.276528] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.276595] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.276793] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.276952] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.277993] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.277993] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.277993] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.278200] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.278200] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5333cddc-c089-40b3-9eba-dc3f40477cac',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.781032] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.781206] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.781271] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.781611] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.804867] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.805466] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.805466] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.805466] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.805466] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.805664] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.805664] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5333cddc-c089-40b3-9eba-dc3f40477cac is going to be updated. [ 848.834903] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.834903] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.834903] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.834903] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.834903] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.843722] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5333cddc-c089-40b3-9eba-dc3f40477cac in Status: IN_PROGRESS for 2s [ 848.956031] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 in Status: SUCCESS [ 848.956031] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.956031] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.956031] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.956031] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.956031] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.956031] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.956031] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.956031] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.956031] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.956031] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.958374] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.958745] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.959123] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.959440] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.959723] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.961590] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.961590] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.961590] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.961590] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.961590] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.466663] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748: rpc.has_security_group_logging(os_id): False [ 849.482915] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.483168] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.483234] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.483439] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.483532] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.483721] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.483818] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.483881] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.484054] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.484136] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.484331] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.484427] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.484490] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.484634] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.484710] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.484911] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.484980] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.485049] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.485189] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.485264] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.485350] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 is going to be created. [ 849.535658] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.535813] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.535858] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.536432] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.536432] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.551348] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 in Status: IN_PROGRESS for 2s [ 849.554593] env[70013]: INFO networking_nsxv3.common.synchronization [req-62e18d13-1077-4165-9d6e-89b6eb072914 req-ec53c829-97fb-4606-83b7-bbd2887152aa tempest-ListServersNegativeTestJSON-1728183933 tempest-ListServersNegativeTestJSON-1728183933-project-member] Enqueued Resource ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 with Priority: HIGHEST for action security_group_members [ 849.554593] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 with Priority: HIGHEST for action security_group_members [ 849.554593] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.554593] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.554593] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.554593] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.554593] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.554593] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.554593] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.554593] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.554593] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.554593] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.909027] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-392 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.909027] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-392" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.909027] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-392" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.909027] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-392" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.909253] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.909346] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.909491] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.909727] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.911109] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.911109] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 849.911109] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 849.911109] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 849.911109] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 849.911109] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 849.911109] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 849.911109] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 849.930203] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 849.930508] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 849.930671] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 849.930866] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-392" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.931197] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-36d75dbd-aa9f-46d8-ad64-f95577fdb5f6 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.931375] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-36d75dbd-aa9f-46d8-ad64-f95577fdb5f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.931503] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-36d75dbd-aa9f-46d8-ad64-f95577fdb5f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.931865] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-36d75dbd-aa9f-46d8-ad64-f95577fdb5f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.932042] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36d75dbd-aa9f-46d8-ad64-f95577fdb5f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.056579] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.435439] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.435696] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.435964] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.436156] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.436335] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.437028] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 36d75dbd-aa9f-46d8-ad64-f95577fdb5f6 not found, creating... [ 850.437028] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.437028] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.437213] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.437281] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.437424] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.437710] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.437866] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.437982] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.442487] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.442578] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.442738] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 36d75dbd-aa9f-46d8-ad64-f95577fdb5f6 is going to be created. [ 850.467959] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.467959] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.467959] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.467959] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.467959] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.467959] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-36d75dbd-aa9f-46d8-ad64-f95577fdb5f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.557695] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.856781] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5333cddc-c089-40b3-9eba-dc3f40477cac in Status: SUCCESS [ 850.856781] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5333cddc-c089-40b3-9eba-dc3f40477cac deletion is rescheduled due to dependency. [ 850.856781] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.060601] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.061768] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.061768] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.061768] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.061768] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.061768] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 is going to be updated. [ 851.094513] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.094637] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.094790] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.095512] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.095512] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.105525] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 in Status: IN_PROGRESS for 2s [ 851.151662] env[70013]: INFO networking_nsxv3.common.synchronization [req-62e18d13-1077-4165-9d6e-89b6eb072914 req-1c4f4900-7796-4709-882d-f808faaaf5cb service nova] Enqueued Resource ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 with Priority: HIGHEST for action security_group_rules [ 851.151931] env[70013]: INFO networking_nsxv3.common.synchronization [req-62e18d13-1077-4165-9d6e-89b6eb072914 req-1c4f4900-7796-4709-882d-f808faaaf5cb service nova] Enqueued Resource ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 with Priority: HIGHEST for action security_group_members [ 851.152104] env[70013]: INFO networking_nsxv3.common.synchronization [req-62e18d13-1077-4165-9d6e-89b6eb072914 req-1c4f4900-7796-4709-882d-f808faaaf5cb service nova] Enqueued Resource ID: 36d75dbd-aa9f-46d8-ad64-f95577fdb5f6 with Priority: HIGHEST for action port [ 851.152427] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 with Priority: HIGHEST for action security_group_rules [ 851.152556] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 with Priority: HIGHEST for action security_group_members [ 851.152655] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36d75dbd-aa9f-46d8-ad64-f95577fdb5f6 with Priority: HIGHEST for action port [ 851.153355] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.153471] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.153671] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.153758] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.153937] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-36d75dbd-aa9f-46d8-ad64-f95577fdb5f6 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.154049] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36d75dbd-aa9f-46d8-ad64-f95577fdb5f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.154116] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36d75dbd-aa9f-46d8-ad64-f95577fdb5f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.154319] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36d75dbd-aa9f-46d8-ad64-f95577fdb5f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.154401] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36d75dbd-aa9f-46d8-ad64-f95577fdb5f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.562281] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 in Status: SUCCESS [ 851.562562] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.562705] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.562913] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.562998] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.656796] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36d75dbd-aa9f-46d8-ad64-f95577fdb5f6 with status ACTIVE [ 851.657034] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.657173] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.657243] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.657462] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.658069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.658069] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.658069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.658069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.658069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.658069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.658341] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.658482] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.658548] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.658693] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.658764] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.658849] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36d75dbd-aa9f-46d8-ad64-f95577fdb5f6 is going to be updated. [ 851.678704] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.678849] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.678921] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.679147] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.679400] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.679571] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36d75dbd-aa9f-46d8-ad64-f95577fdb5f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.066264] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.066426] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.655815] env[70013]: INFO networking_nsxv3.common.synchronization [None req-8f98a581-f6d1-4d6c-8003-89ce6b043d8c tempest-ServerActionsTestJSON-1661939768 tempest-ServerActionsTestJSON-1661939768-project-member] Enqueued Resource ID: 0776053c-3635-4232-86b2-1a586b64e542 with Priority: HIGHEST for action security_group_rules [ 852.656173] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0776053c-3635-4232-86b2-1a586b64e542 with Priority: HIGHEST for action security_group_rules [ 852.657710] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0776053c-3635-4232-86b2-1a586b64e542 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.657710] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.657710] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.657710] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.657710] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0776053c-3635-4232-86b2-1a586b64e542',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.736299] env[70013]: INFO networking_nsxv3.common.synchronization [None req-4e051308-acef-481a-94f9-0bfdd02248fa tempest-ServerActionsTestJSON-1661939768 tempest-ServerActionsTestJSON-1661939768-project-member] Enqueued Resource ID: 0776053c-3635-4232-86b2-1a586b64e542 with Priority: HIGHEST for action security_group_rules [ 852.736973] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0776053c-3635-4232-86b2-1a586b64e542 with Priority: HIGHEST for action security_group_rules [ 852.737757] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0776053c-3635-4232-86b2-1a586b64e542 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.737916] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.113074] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 in Status: SUCCESS [ 853.113327] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.113583] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.113806] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.117016] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.117016] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.117016] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.117016] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.117016] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.117016] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.176131] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.176569] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.176569] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.176757] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.176875] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.177020] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0776053c-3635-4232-86b2-1a586b64e542 already deleted. [ 853.177119] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.177321] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.177539] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.177635] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0776053c-3635-4232-86b2-1a586b64e542',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.617541] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.697182] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.697500] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.697500] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.697611] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.697701] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.697799] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0776053c-3635-4232-86b2-1a586b64e542 already deleted. [ 853.697881] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.123637] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.625522] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.625682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.625760] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.626045] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.626153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.626390] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 is going to be updated. [ 854.652671] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.652825] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.652877] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.653101] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.653274] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.663440] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 in Status: IN_PROGRESS for 2s [ 856.673900] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 in Status: SUCCESS [ 856.674339] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.674339] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.674538] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.674647] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.674813] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.674813] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.675027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.675096] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.675140] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.675217] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.177449] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.177595] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.177670] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.177898] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.178107] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.180493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.180493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.180493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.180493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.180493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.180493] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.180493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.180493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.180493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.180493] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.180493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.180493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.180493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.180493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.180493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.180493] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.478674] env[70013]: INFO networking_nsxv3.common.synchronization [None req-e3d013c7-d6dc-4e62-8d65-3450048bd05c None None] Enqueued Resource ID: 59a0c35c-04fd-4726-93dc-47dcf777dd82 with Priority: HIGHEST for action port [ 857.480458] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59a0c35c-04fd-4726-93dc-47dcf777dd82 with Priority: HIGHEST for action port [ 857.480458] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-59a0c35c-04fd-4726-93dc-47dcf777dd82 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.484142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59a0c35c-04fd-4726-93dc-47dcf777dd82" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.484238] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59a0c35c-04fd-4726-93dc-47dcf777dd82" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.484518] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59a0c35c-04fd-4726-93dc-47dcf777dd82" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.484636] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59a0c35c-04fd-4726-93dc-47dcf777dd82',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.538751] env[70013]: INFO networking_nsxv3.common.synchronization [req-bf99e76a-ff52-4a95-906e-6f83862c66cc req-7a696e7b-707d-46d9-ac60-26192ba057f1 tempest-ListImageFiltersTestJSON-2117804784 tempest-ListImageFiltersTestJSON-2117804784-project-member] Enqueued Resource ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 with Priority: HIGHEST for action security_group_members [ 857.538751] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 with Priority: HIGHEST for action security_group_members [ 857.539082] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.539204] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.539270] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.539585] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.539694] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.539788] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.539848] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.539999] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.540152] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.540263] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf5314a2-236c-4f4a-b8ea-d899149c1ea8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.682152] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748: rpc.has_security_group_logging(os_id): False [ 857.699271] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.699490] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.699746] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.699746] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.700364] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.700364] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.700364] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.700364] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.700820] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.700820] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.701307] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.701307] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.701307] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.702134] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.702134] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.702134] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.702134] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.702134] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.702584] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.702584] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.702584] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 is going to be updated. [ 857.773143] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.773289] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.773356] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.773574] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.773724] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.787630] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 in Status: IN_PROGRESS for 2s [ 857.986759] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 59a0c35c-04fd-4726-93dc-47dcf777dd82 [ 857.987046] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.987187] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.987260] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.987486] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.987585] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.987684] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:59a0c35c-04fd-4726-93dc-47dcf777dd82 already deleted. [ 857.987765] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59a0c35c-04fd-4726-93dc-47dcf777dd82" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.045991] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.046682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.046682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.046682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.046682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.046922] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.047065] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.047134] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.047297] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.047398] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.047506] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 already deleted. [ 858.047862] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.075475] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-701 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.075714] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.075846] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.076219] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.076970] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.076970] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.076970] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.077205] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.077357] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.077586] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 858.077740] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 858.077885] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 858.078048] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 858.078204] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 858.078360] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 858.079548] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 858.101782] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 858.102065] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 858.102121] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 858.102336] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.102711] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-826e6050-1881-4e29-a740-868fa0f44788 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.102890] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-826e6050-1881-4e29-a740-868fa0f44788" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.103027] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-826e6050-1881-4e29-a740-868fa0f44788" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.103366] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-826e6050-1881-4e29-a740-868fa0f44788" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.103509] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('826e6050-1881-4e29-a740-868fa0f44788',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.608073] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.608324] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.608451] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.609765] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.609765] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.609765] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 826e6050-1881-4e29-a740-868fa0f44788 not found, creating... [ 858.609765] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.609765] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.609765] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.610104] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.610104] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.610308] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.610607] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.610607] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.611034] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.611034] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.611220] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 826e6050-1881-4e29-a740-868fa0f44788 is going to be created. [ 858.630042] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.630277] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.630409] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.630677] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.630911] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.631192] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-826e6050-1881-4e29-a740-868fa0f44788" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.349020] env[70013]: INFO networking_nsxv3.common.synchronization [None req-92463e00-c7d7-49e7-936f-9fc40af165bd None None] Enqueued Resource ID: aa32ba5a-cbb1-4c7d-820f-690b0f506034 with Priority: HIGHEST for action port [ 859.349887] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa32ba5a-cbb1-4c7d-820f-690b0f506034 with Priority: HIGHEST for action port [ 859.351187] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa32ba5a-cbb1-4c7d-820f-690b0f506034 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.351511] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa32ba5a-cbb1-4c7d-820f-690b0f506034" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.351511] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa32ba5a-cbb1-4c7d-820f-690b0f506034" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.351854] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa32ba5a-cbb1-4c7d-820f-690b0f506034" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.353261] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa32ba5a-cbb1-4c7d-820f-690b0f506034',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.522797] env[70013]: INFO networking_nsxv3.common.synchronization [req-bf99e76a-ff52-4a95-906e-6f83862c66cc req-6daab3d7-35d2-40cb-8777-8d566dde9c17 service nova] Enqueued Resource ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 with Priority: HIGHEST for action security_group_rules [ 859.522797] env[70013]: INFO networking_nsxv3.common.synchronization [req-bf99e76a-ff52-4a95-906e-6f83862c66cc req-6daab3d7-35d2-40cb-8777-8d566dde9c17 service nova] Enqueued Resource ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 with Priority: HIGHEST for action security_group_members [ 859.522797] env[70013]: INFO networking_nsxv3.common.synchronization [req-bf99e76a-ff52-4a95-906e-6f83862c66cc req-6daab3d7-35d2-40cb-8777-8d566dde9c17 service nova] Enqueued Resource ID: 826e6050-1881-4e29-a740-868fa0f44788 with Priority: HIGHEST for action port [ 859.526967] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 with Priority: HIGHEST for action security_group_rules [ 859.527175] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 with Priority: HIGHEST for action security_group_members [ 859.527321] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 826e6050-1881-4e29-a740-868fa0f44788 with Priority: HIGHEST for action port [ 859.527979] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf5314a2-236c-4f4a-b8ea-d899149c1ea8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.528168] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.528267] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.528556] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.528644] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf5314a2-236c-4f4a-b8ea-d899149c1ea8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.529506] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.529670] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.529670] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.530440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.530440] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.530440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.532728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.532728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.532728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.532728] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf5314a2-236c-4f4a-b8ea-d899149c1ea8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.532728] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-826e6050-1881-4e29-a740-868fa0f44788 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.532728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-826e6050-1881-4e29-a740-868fa0f44788" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.532728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-826e6050-1881-4e29-a740-868fa0f44788" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.532728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-826e6050-1881-4e29-a740-868fa0f44788" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.532728] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('826e6050-1881-4e29-a740-868fa0f44788',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.806477] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 in Status: SUCCESS [ 859.806477] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.806477] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.806477] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.806477] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.858457] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa32ba5a-cbb1-4c7d-820f-690b0f506034 [ 859.858723] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.858892] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.859012] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.859233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.859282] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.859421] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa32ba5a-cbb1-4c7d-820f-690b0f506034 already deleted. [ 859.859558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa32ba5a-cbb1-4c7d-820f-690b0f506034" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.034501] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.034603] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.034805] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf5314a2-236c-4f4a-b8ea-d899149c1ea8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.040709] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 826e6050-1881-4e29-a740-868fa0f44788 with status ACTIVE [ 860.044025] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.044025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.044025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.044025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.044025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.044025] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.044025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.044025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.044025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.044025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.044025] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.044025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.044025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.044025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.044025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.044025] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 826e6050-1881-4e29-a740-868fa0f44788 is going to be updated. [ 860.065577] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.065769] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.065868] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.066312] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.066510] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.066714] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-826e6050-1881-4e29-a740-868fa0f44788" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.308425] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.308692] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.308910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.309222] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.309517] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.310039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.311126] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.311369] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.311510] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.311647] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.311799] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.542628] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf5314a2-236c-4f4a-b8ea-d899149c1ea8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.550268] env[70013]: INFO networking_nsxv3.common.synchronization [None req-df778c56-7f36-4a40-8710-b90f8682d3a3 None None] Enqueued Resource ID: 95fcfa50-d596-4e74-ae57-7d81fc00c496 with Priority: HIGHEST for action port [ 860.552113] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95fcfa50-d596-4e74-ae57-7d81fc00c496 with Priority: HIGHEST for action port [ 860.552523] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-95fcfa50-d596-4e74-ae57-7d81fc00c496 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.552654] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95fcfa50-d596-4e74-ae57-7d81fc00c496" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.552726] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95fcfa50-d596-4e74-ae57-7d81fc00c496" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.552995] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95fcfa50-d596-4e74-ae57-7d81fc00c496" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.553097] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95fcfa50-d596-4e74-ae57-7d81fc00c496',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.814903] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.814903] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.814903] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.814903] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.815197] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.815197] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.815279] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.815379] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.815475] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.815548] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.815942] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.816055] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.816126] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.816328] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.816508] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.816628] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.816663] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.819017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.819017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.819017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.819017] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.045932] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.045932] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.045932] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.048075] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.048075] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.048075] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 is going to be created. [ 861.057377] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95fcfa50-d596-4e74-ae57-7d81fc00c496 [ 861.057645] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.058049] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.058049] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.058376] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.058376] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.058850] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95fcfa50-d596-4e74-ae57-7d81fc00c496 already deleted. [ 861.058850] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95fcfa50-d596-4e74-ae57-7d81fc00c496" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.076034] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.076034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.076210] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.076876] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.076876] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.086140] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 in Status: UNINITIALIZED for 2s [ 861.321552] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748: rpc.has_security_group_logging(os_id): False [ 861.344374] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.344374] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.344374] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.344374] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.344374] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.344374] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.344374] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.344374] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.344374] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.344374] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.344374] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.344789] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.344789] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.344789] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.344789] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.344922] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.344966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.345071] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.345218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.345263] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.345315] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 is going to be updated. [ 861.405866] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.406052] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.406123] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.406362] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.406521] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.421105] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 in Status: IN_PROGRESS for 2s [ 862.449709] env[70013]: INFO networking_nsxv3.common.synchronization [req-55c54865-9714-426c-acf5-9dd59b5b911f req-a1e75efb-8fa8-460b-a773-92f80a8dbc79 tempest-ListServersNegativeTestJSON-1728183933 tempest-ListServersNegativeTestJSON-1728183933-project-member] Enqueued Resource ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 with Priority: HIGHEST for action security_group_members [ 862.450690] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 with Priority: HIGHEST for action security_group_members [ 862.451016] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.452208] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.452287] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.452801] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.452801] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.452905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.452905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.454135] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.454240] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.454341] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.902051] env[70013]: INFO networking_nsxv3.common.synchronization [None req-78f590a8-4179-4c17-a69d-109e5db36c42 None None] Enqueued Resource ID: 384d0329-97cf-4d15-99df-f41f6a600fd6 with Priority: HIGHEST for action port [ 862.902323] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 384d0329-97cf-4d15-99df-f41f6a600fd6 with Priority: HIGHEST for action port [ 862.902946] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-384d0329-97cf-4d15-99df-f41f6a600fd6 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.903098] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-384d0329-97cf-4d15-99df-f41f6a600fd6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.903170] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-384d0329-97cf-4d15-99df-f41f6a600fd6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.903421] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-384d0329-97cf-4d15-99df-f41f6a600fd6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.903516] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('384d0329-97cf-4d15-99df-f41f6a600fd6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.957279] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.097085] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 in Status: SUCCESS [ 863.097320] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.097493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.097728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.097925] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.098055] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.098122] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.098284] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.098367] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.098451] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.098545] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf5314a2-236c-4f4a-b8ea-d899149c1ea8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.349317] env[70013]: INFO networking_nsxv3.common.synchronization [req-e48523d2-22e0-40c3-9b7a-3637dfd74f7e req-d0652930-edca-4cef-a01b-77a273e1c6c4 tempest-ListImageFiltersTestJSON-2117804784 tempest-ListImageFiltersTestJSON-2117804784-project-member] Enqueued Resource ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 with Priority: HIGHEST for action security_group_members [ 863.349865] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 with Priority: HIGHEST for action security_group_members [ 863.350255] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.350418] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.350496] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.350702] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.350893] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.350999] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.351078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.351266] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.351374] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.351498] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf5314a2-236c-4f4a-b8ea-d899149c1ea8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.407630] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 384d0329-97cf-4d15-99df-f41f6a600fd6 [ 863.407863] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.407997] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.408083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.408296] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.408385] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.408482] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:384d0329-97cf-4d15-99df-f41f6a600fd6 already deleted. [ 863.408565] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-384d0329-97cf-4d15-99df-f41f6a600fd6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.435412] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 in Status: SUCCESS [ 863.438346] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.459302] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.600721] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.600898] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.658022] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-701 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.658235] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.658367] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.658652] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.659164] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.659164] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.659306] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.659402] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.659556] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.659761] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 863.659873] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 863.660026] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 863.660098] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 863.660207] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 863.660331] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 863.660451] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 863.677748] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 863.678037] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 863.678198] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 863.678371] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.678684] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-089cfbb7-4a17-4371-949f-06f761b4c32b taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.678912] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-089cfbb7-4a17-4371-949f-06f761b4c32b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.679184] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-089cfbb7-4a17-4371-949f-06f761b4c32b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.679403] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-089cfbb7-4a17-4371-949f-06f761b4c32b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.679566] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('089cfbb7-4a17-4371-949f-06f761b4c32b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.853843] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf5314a2-236c-4f4a-b8ea-d899149c1ea8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.962027] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.962252] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.962366] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.962733] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.962881] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.963050] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 is going to be updated. [ 863.990070] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.990070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.990070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.990318] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.990318] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.999191] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 in Status: IN_PROGRESS for 2s [ 864.182370] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.182631] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.182765] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.183068] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.183247] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.183416] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 089cfbb7-4a17-4371-949f-06f761b4c32b not found, creating... [ 864.183701] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.183863] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.183984] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.184296] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.184518] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.184830] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.184991] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.185334] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.185569] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.185713] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.185882] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 089cfbb7-4a17-4371-949f-06f761b4c32b is going to be created. [ 864.222360] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.222614] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.222745] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.223093] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.223338] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.223598] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-089cfbb7-4a17-4371-949f-06f761b4c32b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.356336] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf5314a2-236c-4f4a-b8ea-d899149c1ea8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.860351] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.860351] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.860351] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.860351] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.860351] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.860351] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 is going to be updated. [ 864.885592] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.885754] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.885801] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.886057] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.886211] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.892905] env[70013]: INFO networking_nsxv3.common.synchronization [req-e48523d2-22e0-40c3-9b7a-3637dfd74f7e req-755abe03-5abe-44d2-9978-c62da0de2a16 service nova] Enqueued Resource ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 with Priority: HIGHEST for action security_group_rules [ 864.893096] env[70013]: INFO networking_nsxv3.common.synchronization [req-e48523d2-22e0-40c3-9b7a-3637dfd74f7e req-755abe03-5abe-44d2-9978-c62da0de2a16 service nova] Enqueued Resource ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 with Priority: HIGHEST for action security_group_members [ 864.893239] env[70013]: INFO networking_nsxv3.common.synchronization [req-e48523d2-22e0-40c3-9b7a-3637dfd74f7e req-755abe03-5abe-44d2-9978-c62da0de2a16 service nova] Enqueued Resource ID: 089cfbb7-4a17-4371-949f-06f761b4c32b with Priority: HIGHEST for action port [ 864.893492] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 with Priority: HIGHEST for action security_group_rules [ 864.893629] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 with Priority: HIGHEST for action security_group_members [ 864.893736] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 089cfbb7-4a17-4371-949f-06f761b4c32b with Priority: HIGHEST for action port [ 864.894795] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 in Status: IN_PROGRESS for 2s [ 864.895905] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf5314a2-236c-4f4a-b8ea-d899149c1ea8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.896057] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.898148] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.898258] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.898472] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-089cfbb7-4a17-4371-949f-06f761b4c32b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.898579] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-089cfbb7-4a17-4371-949f-06f761b4c32b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.898649] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-089cfbb7-4a17-4371-949f-06f761b4c32b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.898852] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-089cfbb7-4a17-4371-949f-06f761b4c32b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.898933] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('089cfbb7-4a17-4371-949f-06f761b4c32b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.405825] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 089cfbb7-4a17-4371-949f-06f761b4c32b with status ACTIVE [ 865.405825] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.405825] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.405825] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.405825] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.405825] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.405825] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.405825] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.406154] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.406154] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.406154] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.406375] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.406767] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.406767] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.406767] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.406767] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.406972] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 089cfbb7-4a17-4371-949f-06f761b4c32b is going to be updated. [ 865.426096] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.426278] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.426278] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.426485] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.426626] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.426806] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-089cfbb7-4a17-4371-949f-06f761b4c32b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.010037] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 in Status: SUCCESS [ 866.011044] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.217143] env[70013]: INFO networking_nsxv3.common.synchronization [req-ed6e9213-aae2-4234-8e5d-3d35624efdee req-5b117544-775f-4307-a380-c3119ce14a29 tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_members [ 866.217143] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_members [ 866.217143] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.217143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.217143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.217143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.217754] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.218062] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.218256] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.218685] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.218908] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.219147] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.502617] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-762 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.502827] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-762" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.502957] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-762" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.503252] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-762" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.503807] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.503962] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.504707] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.504707] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.504707] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.504707] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 866.504938] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 866.505011] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 866.505128] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 866.505245] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 866.505351] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 866.505488] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 866.522632] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 866.522893] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 866.522959] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 866.523129] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-762" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.523557] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-d219e46c-ef15-4dec-a495-31e92d46d0c0 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.523726] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-d219e46c-ef15-4dec-a495-31e92d46d0c0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.523856] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-d219e46c-ef15-4dec-a495-31e92d46d0c0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.524185] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-d219e46c-ef15-4dec-a495-31e92d46d0c0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.524331] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d219e46c-ef15-4dec-a495-31e92d46d0c0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.722964] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.906190] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 in Status: SUCCESS [ 866.906190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.906291] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.906532] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.906729] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.906852] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.906909] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.907081] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.910208] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.910413] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.910605] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.910697] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.910761] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.910912] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.911064] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.911161] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.911223] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.911363] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.911441] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.911522] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.911607] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf5314a2-236c-4f4a-b8ea-d899149c1ea8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.912589] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.912791] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.912947] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.913069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.913139] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.913287] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.913366] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.913464] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf5314a2-236c-4f4a-b8ea-d899149c1ea8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.027024] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.027356] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.027356] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.027546] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.027699] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.028150] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port d219e46c-ef15-4dec-a495-31e92d46d0c0 not found, creating... [ 867.028150] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.028335] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.028370] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.028847] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.028847] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.029046] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.029150] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.029256] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.029462] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.029597] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.029734] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: d219e46c-ef15-4dec-a495-31e92d46d0c0 is going to be created. [ 867.050875] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.051143] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.051277] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.051543] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.051777] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.052027] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-d219e46c-ef15-4dec-a495-31e92d46d0c0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.225640] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.415684] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf5314a2-236c-4f4a-b8ea-d899149c1ea8: rpc.has_security_group_logging(os_id): False [ 867.416987] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf5314a2-236c-4f4a-b8ea-d899149c1ea8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.434195] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.434325] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.434393] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.434603] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.434685] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.434931] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.435071] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.435132] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.435282] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.435354] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.435549] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.435644] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.435701] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.435841] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.435909] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.436106] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.436186] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.436244] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.436377] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.436445] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.436524] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 is going to be created. [ 867.493175] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.493324] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.493396] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.493644] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.493828] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.503892] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 in Status: IN_PROGRESS for 2s [ 867.729675] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.729984] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.729984] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.731469] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.731469] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.731469] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d47d19df-e406-4c01-9cf0-1110c7c55440 is going to be updated. [ 867.739054] env[70013]: INFO networking_nsxv3.common.synchronization [req-ed6e9213-aae2-4234-8e5d-3d35624efdee req-9eabeb4e-48fe-4a54-83f2-cc8b96bd7f40 service nova] Enqueued Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_rules [ 867.739054] env[70013]: INFO networking_nsxv3.common.synchronization [req-ed6e9213-aae2-4234-8e5d-3d35624efdee req-9eabeb4e-48fe-4a54-83f2-cc8b96bd7f40 service nova] Enqueued Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_members [ 867.739054] env[70013]: INFO networking_nsxv3.common.synchronization [req-ed6e9213-aae2-4234-8e5d-3d35624efdee req-9eabeb4e-48fe-4a54-83f2-cc8b96bd7f40 service nova] Enqueued Resource ID: d219e46c-ef15-4dec-a495-31e92d46d0c0 with Priority: HIGHEST for action port [ 867.739270] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_rules [ 867.739455] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_members [ 867.739619] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d219e46c-ef15-4dec-a495-31e92d46d0c0 with Priority: HIGHEST for action port [ 867.740272] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.740497] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.740550] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.740996] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.740996] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.741763] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.741845] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.742064] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-d219e46c-ef15-4dec-a495-31e92d46d0c0 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.742790] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d219e46c-ef15-4dec-a495-31e92d46d0c0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.742878] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d219e46c-ef15-4dec-a495-31e92d46d0c0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.743083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d219e46c-ef15-4dec-a495-31e92d46d0c0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.743168] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d219e46c-ef15-4dec-a495-31e92d46d0c0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.775654] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.775827] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.775865] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.776084] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.776232] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.789106] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: IN_PROGRESS for 2s [ 867.919483] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf5314a2-236c-4f4a-b8ea-d899149c1ea8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.245550] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d219e46c-ef15-4dec-a495-31e92d46d0c0 with status ACTIVE [ 868.245850] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.245932] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.245984] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.246184] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.246280] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.246461] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.246565] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.246630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.246779] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.246855] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.247047] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.247145] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.247206] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.247345] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.247421] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.247508] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d219e46c-ef15-4dec-a495-31e92d46d0c0 is going to be updated. [ 868.248649] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.248764] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.270496] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.271284] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.271284] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.271284] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.271284] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.271284] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d219e46c-ef15-4dec-a495-31e92d46d0c0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.422123] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.422288] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.422354] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.422603] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.422696] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.422803] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 is going to be updated. [ 868.464591] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.464926] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.465009] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.465729] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.465729] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.477621] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 in Status: IN_PROGRESS for 2s [ 869.189663] env[70013]: INFO networking_nsxv3.common.synchronization [req-5e724a73-9268-4e66-98ca-3ffb35e160ae req-3a1c52ef-7df4-43a9-8d5c-6bec322f07c2 tempest-ServersWithSpecificFlavorTestJSON-1827464871 tempest-ServersWithSpecificFlavorTestJSON-1827464871-project-member] Enqueued Resource ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 with Priority: HIGHEST for action security_group_members [ 869.190523] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 with Priority: HIGHEST for action security_group_members [ 869.190976] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.191173] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.191261] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.191643] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.192717] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.192717] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.192717] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.192717] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.192717] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.195661] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.516865] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 in Status: SUCCESS [ 869.517146] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.517294] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.517506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.517594] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf5314a2-236c-4f4a-b8ea-d899149c1ea8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.699061] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.699237] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.699319] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.699552] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.699651] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.699873] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.699969] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.700052] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.700242] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.700329] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.700499] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 is going to be updated. [ 869.741111] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.741559] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.741559] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.741559] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.741742] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.751115] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 in Status: IN_PROGRESS for 2s [ 869.794698] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: SUCCESS [ 869.794941] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.795124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.795338] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.795516] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.795626] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.795687] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.795832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.795908] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.796008] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.020499] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.020690] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.298025] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.489058] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 in Status: SUCCESS [ 870.489058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.489058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.489222] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.489460] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.489640] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.489893] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.490206] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.490376] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.490494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.491035] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf5314a2-236c-4f4a-b8ea-d899149c1ea8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.801862] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.933718] env[70013]: INFO networking_nsxv3.common.synchronization [req-73fbd504-e53f-43f1-9171-7f60db02f2ed req-3063a849-d350-46a4-a43d-a099f78a6feb tempest-ServersAdminTestJSON-1183835690 tempest-ServersAdminTestJSON-1183835690-project-member] Enqueued Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_members [ 870.937883] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_members [ 870.938647] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7abade-e912-4196-b558-4a6d4ece9b29 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.938817] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.938927] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.939121] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.939333] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.939441] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.939441] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.939620] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.939709] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.939782] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.992961] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.993118] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.993217] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.993420] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.993568] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.993670] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.993726] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.993862] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.993981] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.994041] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.994185] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.994276] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.994350] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.994475] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.994608] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.994697] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.994758] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.994905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.994982] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.995077] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.995165] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf5314a2-236c-4f4a-b8ea-d899149c1ea8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.209094] env[70013]: INFO networking_nsxv3.common.synchronization [req-9f5cae10-eeb3-457f-8501-2f84dc54b1fa req-c475afb8-00fc-4755-8e3e-f0f385cd4c5b tempest-ServersNegativeTestJSON-128962351 tempest-ServersNegativeTestJSON-128962351-project-member] Enqueued Resource ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 with Priority: HIGHEST for action security_group_members [ 871.209669] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 with Priority: HIGHEST for action security_group_members [ 871.214039] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b51e70d-5edb-4332-99e9-eb53e6015365 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.214039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.214039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.214039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.214039] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.214039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.214039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.214039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.214039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.214039] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.304103] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.304282] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.304348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.304565] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.304661] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.304766] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d47d19df-e406-4c01-9cf0-1110c7c55440 is going to be updated. [ 871.333577] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.333719] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.333787] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.334019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.334204] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.343272] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: IN_PROGRESS for 2s [ 871.443613] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.499235] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf5314a2-236c-4f4a-b8ea-d899149c1ea8: rpc.has_security_group_logging(os_id): False [ 871.517163] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.517163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.517163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.517163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.517163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.517163] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.517163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.517163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.517163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.517163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.517163] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.517163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.517163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.517163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.517163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.518079] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.518403] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.518576] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.519220] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.519404] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.519571] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 is going to be updated. [ 871.546816] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-35 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.546816] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-35" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.546816] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-35" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.548236] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-35" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.548236] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.548236] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.548236] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.548236] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.548236] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.548236] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 871.548545] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 871.548545] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 871.548545] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 871.548670] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 871.551044] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 871.551044] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 871.565385] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 871.565551] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 871.565690] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 871.565886] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-35" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.566182] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-1217e13a-a21e-45bc-96a7-abdecc27de51 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.566443] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-1217e13a-a21e-45bc-96a7-abdecc27de51" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.566603] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-1217e13a-a21e-45bc-96a7-abdecc27de51" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.566915] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-1217e13a-a21e-45bc-96a7-abdecc27de51" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.567075] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1217e13a-a21e-45bc-96a7-abdecc27de51',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.580753] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.580938] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.581044] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.581284] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.581465] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.594514] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 in Status: IN_PROGRESS for 2s [ 871.715267] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.762231] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 in Status: SUCCESS [ 871.762530] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 deletion is rescheduled due to dependency. [ 871.762530] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.946486] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.071080] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.071080] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.076556] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.076556] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.076556] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.076556] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 1217e13a-a21e-45bc-96a7-abdecc27de51 not found, creating... [ 872.076761] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.076885] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.076992] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.078065] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.078065] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.078065] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.078065] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.078065] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.078310] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.078359] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.078502] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 1217e13a-a21e-45bc-96a7-abdecc27de51 is going to be created. [ 872.097287] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.097490] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.097621] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.098016] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.098143] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.098319] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-1217e13a-a21e-45bc-96a7-abdecc27de51" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.217237] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.448689] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.448898] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.448980] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.449199] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.449290] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.449389] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 is going to be updated. [ 872.475275] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.475275] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.475275] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.475490] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.475528] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.483949] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: IN_PROGRESS for 2s [ 872.720623] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.720623] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.720623] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.721307] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.721577] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.722312] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 is going to be updated. [ 872.747918] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.748149] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.748253] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.748468] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.748617] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.756790] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 in Status: IN_PROGRESS for 2s [ 872.791229] env[70013]: INFO networking_nsxv3.common.synchronization [req-9f5cae10-eeb3-457f-8501-2f84dc54b1fa req-c357b18c-8d7b-4b23-bb12-ad0a5b08657a service nova] Enqueued Resource ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 with Priority: HIGHEST for action security_group_rules [ 872.791403] env[70013]: INFO networking_nsxv3.common.synchronization [req-9f5cae10-eeb3-457f-8501-2f84dc54b1fa req-c357b18c-8d7b-4b23-bb12-ad0a5b08657a service nova] Enqueued Resource ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 with Priority: HIGHEST for action security_group_members [ 872.791571] env[70013]: INFO networking_nsxv3.common.synchronization [req-9f5cae10-eeb3-457f-8501-2f84dc54b1fa req-c357b18c-8d7b-4b23-bb12-ad0a5b08657a service nova] Enqueued Resource ID: 1217e13a-a21e-45bc-96a7-abdecc27de51 with Priority: HIGHEST for action port [ 872.791812] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 with Priority: HIGHEST for action security_group_rules [ 872.791936] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 with Priority: HIGHEST for action security_group_members [ 872.792071] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1217e13a-a21e-45bc-96a7-abdecc27de51 with Priority: HIGHEST for action port [ 872.792587] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b51e70d-5edb-4332-99e9-eb53e6015365 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.792708] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.792776] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.792972] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.793687] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.794541] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b51e70d-5edb-4332-99e9-eb53e6015365 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.794856] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.795094] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-1217e13a-a21e-45bc-96a7-abdecc27de51 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.795202] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1217e13a-a21e-45bc-96a7-abdecc27de51" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.795267] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1217e13a-a21e-45bc-96a7-abdecc27de51" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.795444] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1217e13a-a21e-45bc-96a7-abdecc27de51" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.795523] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1217e13a-a21e-45bc-96a7-abdecc27de51',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.298206] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b51e70d-5edb-4332-99e9-eb53e6015365 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.298532] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.299761] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1217e13a-a21e-45bc-96a7-abdecc27de51 with status ACTIVE [ 873.299994] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.300249] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.300249] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.300501] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.300619] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.301294] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.301394] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.301466] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.301689] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.301790] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.301994] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.302142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.302211] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.302368] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.302477] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.302664] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1217e13a-a21e-45bc-96a7-abdecc27de51 is going to be updated. [ 873.341365] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.341569] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.341569] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.341796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.341940] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.342111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1217e13a-a21e-45bc-96a7-abdecc27de51" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.361132] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: SUCCESS [ 873.361366] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.361585] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.361859] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.362024] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.362150] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.362217] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.362371] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.362454] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.362626] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.362725] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.609650] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 in Status: SUCCESS [ 873.610131] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.865206] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.865363] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.865363] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.865942] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.865942] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.865942] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.865942] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.866187] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.866187] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.866252] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.867110] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.867110] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.867110] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.867110] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.867110] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.867110] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.867110] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.867110] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.867507] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.867507] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.867507] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.370312] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d47d19df-e406-4c01-9cf0-1110c7c55440: rpc.has_security_group_logging(os_id): False [ 874.388204] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.388360] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.388431] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.388653] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.389185] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.389185] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.389185] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.389185] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.389441] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.389441] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.389560] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.389604] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.389663] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.389803] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.389877] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.390077] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.390194] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.390242] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.390356] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.390449] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.390558] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d47d19df-e406-4c01-9cf0-1110c7c55440 is going to be updated. [ 874.465129] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.465286] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.465362] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.465574] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.465720] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.475931] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: IN_PROGRESS for 2s [ 874.491928] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: SUCCESS [ 874.492166] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.766182] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 in Status: SUCCESS [ 874.766494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.766733] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.766986] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.767271] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.767404] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.767477] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.767667] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.767758] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.767882] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.269882] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.772067] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.160444] env[70013]: INFO networking_nsxv3.common.synchronization [req-b327bb9d-0787-430c-b40d-be2968095744 req-f55fabeb-e178-485b-9844-097a65fcdacb tempest-ServersAdminNegativeTestJSON-1634392682 tempest-ServersAdminNegativeTestJSON-1634392682-project-member] Enqueued Resource ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 with Priority: HIGHEST for action security_group_members [ 876.164158] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 with Priority: HIGHEST for action security_group_members [ 876.164335] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.164393] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.164451] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.164745] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.164992] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.165168] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.165253] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.165494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.165616] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.165797] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cff04b9a-dfb1-4bca-9a12-21566cf5fe37',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.255688] env[70013]: INFO networking_nsxv3.common.synchronization [req-aa3740c7-033a-4450-8571-33bab39fd6d7 req-d57b1739-b417-405c-a253-799fdca221af tempest-ServerRescueTestJSONUnderV235-1838383190 tempest-ServerRescueTestJSONUnderV235-1838383190-project-member] Enqueued Resource ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 with Priority: HIGHEST for action security_group_members [ 876.256599] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 with Priority: HIGHEST for action security_group_members [ 876.256599] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.256786] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.256786] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.257011] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.257672] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.257672] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.257672] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.257672] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.257973] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.257973] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ccee96a-c1fb-475b-86c3-7d4f1ccff166',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.275112] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.275251] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.275330] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.275507] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.275622] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.275677] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 is going to be updated. [ 876.303784] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.303913] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.303992] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.304195] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.304336] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.313455] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 in Status: IN_PROGRESS for 2s [ 876.493908] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: SUCCESS [ 876.494251] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.541276] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-729 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.541577] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-729" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.541788] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-729" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.542271] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-729" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.542717] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.542973] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.543194] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.543549] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.543794] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.544132] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 876.544333] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 876.544515] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 876.544683] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 876.544884] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 876.545016] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 876.545174] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 876.564379] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 876.565814] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 876.565814] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 876.566052] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-729" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.566472] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-759215b2-ed99-4281-9bf0-fb9379eab835 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.566670] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-759215b2-ed99-4281-9bf0-fb9379eab835" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.566838] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-759215b2-ed99-4281-9bf0-fb9379eab835" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.568186] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-759215b2-ed99-4281-9bf0-fb9379eab835" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.568402] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('759215b2-ed99-4281-9bf0-fb9379eab835',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.670169] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.670390] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.670662] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.670998] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.671333] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.671640] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.671823] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.676886] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.676886] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.676886] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.676886] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 is going to be updated. [ 876.697147] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.697364] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.697468] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.698360] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.698563] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.707359] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 in Status: IN_PROGRESS for 2s [ 876.759927] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.760071] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.760131] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.760359] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.760461] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.760684] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.760778] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.760843] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.760988] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.761074] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.761161] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 already deleted. [ 876.761243] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.071298] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.071782] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.071782] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.071971] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.072163] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.072331] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 759215b2-ed99-4281-9bf0-fb9379eab835 not found, creating... [ 877.072641] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.072811] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.072976] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.073249] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.073403] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.073732] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.073899] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.074381] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.074679] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.074840] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.074991] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 759215b2-ed99-4281-9bf0-fb9379eab835 is going to be created. [ 877.096303] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.096555] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.096689] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.096988] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.097272] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.097524] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-759215b2-ed99-4281-9bf0-fb9379eab835" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.799861] env[70013]: INFO networking_nsxv3.common.synchronization [req-aa3740c7-033a-4450-8571-33bab39fd6d7 req-892da807-844c-435c-ab8e-20042d8585a6 service nova] Enqueued Resource ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 with Priority: HIGHEST for action security_group_rules [ 877.800031] env[70013]: INFO networking_nsxv3.common.synchronization [req-aa3740c7-033a-4450-8571-33bab39fd6d7 req-892da807-844c-435c-ab8e-20042d8585a6 service nova] Enqueued Resource ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 with Priority: HIGHEST for action security_group_members [ 877.800114] env[70013]: INFO networking_nsxv3.common.synchronization [req-aa3740c7-033a-4450-8571-33bab39fd6d7 req-892da807-844c-435c-ab8e-20042d8585a6 service nova] Enqueued Resource ID: 759215b2-ed99-4281-9bf0-fb9379eab835 with Priority: HIGHEST for action port [ 877.800623] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 with Priority: HIGHEST for action security_group_rules [ 877.800763] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 with Priority: HIGHEST for action security_group_members [ 877.800939] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 759215b2-ed99-4281-9bf0-fb9379eab835 with Priority: HIGHEST for action port [ 877.801151] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ccee96a-c1fb-475b-86c3-7d4f1ccff166 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.801273] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.801340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.801594] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.801676] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ccee96a-c1fb-475b-86c3-7d4f1ccff166',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.802490] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.802738] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.802840] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.803044] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.803214] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.803374] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.803374] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.803526] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.803731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.803862] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ccee96a-c1fb-475b-86c3-7d4f1ccff166',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.804643] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-759215b2-ed99-4281-9bf0-fb9379eab835 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.804760] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-759215b2-ed99-4281-9bf0-fb9379eab835" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.808025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-759215b2-ed99-4281-9bf0-fb9379eab835" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.808025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-759215b2-ed99-4281-9bf0-fb9379eab835" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.808025] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('759215b2-ed99-4281-9bf0-fb9379eab835',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.993012] env[70013]: INFO networking_nsxv3.common.synchronization [req-22911e96-7091-4842-ac2c-7727c71433e0 req-f2a36bf3-6c69-411d-8824-7e8ad611088c tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: a65f6ee5-a363-4a90-a166-504360ba54b1 with Priority: HIGHEST for action security_group_members [ 877.993164] env[70013]: INFO networking_nsxv3.common.synchronization [req-22911e96-7091-4842-ac2c-7727c71433e0 req-f2a36bf3-6c69-411d-8824-7e8ad611088c tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_members [ 877.993702] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a65f6ee5-a363-4a90-a166-504360ba54b1 with Priority: HIGHEST for action security_group_members [ 877.993907] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_members [ 877.997833] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a65f6ee5-a363-4a90-a166-504360ba54b1 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.998022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.998101] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.998368] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.998545] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.998649] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.998719] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.998879] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.998965] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.999076] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a65f6ee5-a363-4a90-a166-504360ba54b1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.999989] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.999989] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.000091] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.000218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.000397] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.000500] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.000562] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.000700] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.000781] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.000887] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.034895] env[70013]: INFO networking_nsxv3.common.synchronization [req-22911e96-7091-4842-ac2c-7727c71433e0 req-f2a36bf3-6c69-411d-8824-7e8ad611088c tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: a65f6ee5-a363-4a90-a166-504360ba54b1 with Priority: HIGHEST for action security_group_rules [ 878.035088] env[70013]: INFO networking_nsxv3.common.synchronization [req-22911e96-7091-4842-ac2c-7727c71433e0 req-f2a36bf3-6c69-411d-8824-7e8ad611088c tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: a65f6ee5-a363-4a90-a166-504360ba54b1 with Priority: HIGHEST for action security_group_members [ 878.035350] env[70013]: INFO networking_nsxv3.common.synchronization [req-22911e96-7091-4842-ac2c-7727c71433e0 req-f2a36bf3-6c69-411d-8824-7e8ad611088c tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_rules [ 878.035500] env[70013]: INFO networking_nsxv3.common.synchronization [req-22911e96-7091-4842-ac2c-7727c71433e0 req-f2a36bf3-6c69-411d-8824-7e8ad611088c tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_members [ 878.035631] env[70013]: INFO networking_nsxv3.common.synchronization [req-22911e96-7091-4842-ac2c-7727c71433e0 req-f2a36bf3-6c69-411d-8824-7e8ad611088c tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: d219e46c-ef15-4dec-a495-31e92d46d0c0 with Priority: HIGHEST for action port [ 878.036088] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a65f6ee5-a363-4a90-a166-504360ba54b1 with Priority: HIGHEST for action security_group_rules [ 878.036222] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_rules [ 878.036318] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d219e46c-ef15-4dec-a495-31e92d46d0c0 with Priority: HIGHEST for action port [ 878.036410] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a65f6ee5-a363-4a90-a166-504360ba54b1 with Priority: HIGHEST for action security_group_members [ 878.036497] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_members [ 878.036835] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a65f6ee5-a363-4a90-a166-504360ba54b1 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.036945] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.036990] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.037243] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.037329] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a65f6ee5-a363-4a90-a166-504360ba54b1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.038118] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.038229] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.038297] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.038458] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.038533] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.039583] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-d219e46c-ef15-4dec-a495-31e92d46d0c0 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.039863] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d219e46c-ef15-4dec-a495-31e92d46d0c0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.039863] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d219e46c-ef15-4dec-a495-31e92d46d0c0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.040194] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d219e46c-ef15-4dec-a495-31e92d46d0c0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.040275] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d219e46c-ef15-4dec-a495-31e92d46d0c0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.041215] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a65f6ee5-a363-4a90-a166-504360ba54b1 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.041301] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.043034] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.043034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.307706] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.307706] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.307706] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5ccee96a-c1fb-475b-86c3-7d4f1ccff166',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.307706] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 759215b2-ed99-4281-9bf0-fb9379eab835 with status ACTIVE [ 878.308289] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.308289] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.308368] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.310705] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.310705] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.310705] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.310705] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.310705] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.310705] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.310705] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.310705] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.310705] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.310705] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.310705] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.310705] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.310705] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 759215b2-ed99-4281-9bf0-fb9379eab835 is going to be updated. [ 878.321606] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 in Status: SUCCESS [ 878.322133] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.322243] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.322466] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.322685] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.322807] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.322873] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.323072] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.323177] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.323329] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.323374] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.331162] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.331241] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.331295] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.331476] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.331629] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.331791] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-759215b2-ed99-4281-9bf0-fb9379eab835" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.502825] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a65f6ee5-a363-4a90-a166-504360ba54b1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.508345] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.542733] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.542842] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.543107] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a65f6ee5-a363-4a90-a166-504360ba54b1 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.543193] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.543335] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d219e46c-ef15-4dec-a495-31e92d46d0c0 with status ACTIVE [ 878.543480] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.543682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.543751] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.543906] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.543991] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.544168] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.544268] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.544315] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.544465] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.544542] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.544716] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.544805] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.544869] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.545037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.545115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.545198] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d219e46c-ef15-4dec-a495-31e92d46d0c0 is going to be updated. [ 878.566244] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.566244] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.566244] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.566244] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.566244] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.566244] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d219e46c-ef15-4dec-a495-31e92d46d0c0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.717296] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 in Status: SUCCESS [ 878.717529] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 deletion is rescheduled due to dependency. [ 878.717609] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.791361] env[70013]: INFO networking_nsxv3.common.synchronization [req-77879ba3-0426-46b3-aaa2-e728628616ab req-2873448e-35ff-433b-8b4f-ce4ab5ed7bfe tempest-ServerActionsTestOtherA-108106573 tempest-ServerActionsTestOtherA-108106573-project-member] Enqueued Resource ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c with Priority: HIGHEST for action security_group_members [ 878.791868] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c with Priority: HIGHEST for action security_group_members [ 878.792235] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.792315] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.792912] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.792912] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.792912] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.792912] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.793107] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.793768] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.794071] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.794071] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca27a1b0-973f-4958-8f7f-a5c216cb9a8c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.812326] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5ccee96a-c1fb-475b-86c3-7d4f1ccff166',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.825637] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b51e70d-5edb-4332-99e9-eb53e6015365 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.825787] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.825853] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.826157] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.826222] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.826401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.826401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.826518] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.826600] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.826680] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.826829] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b51e70d-5edb-4332-99e9-eb53e6015365 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.826912] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.826981] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.827195] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.827334] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.827420] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.827479] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.827622] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.827694] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.827770] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.827863] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.005283] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a65f6ee5-a363-4a90-a166-504360ba54b1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.009874] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.217892] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.218116] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-353" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.218245] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-353" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.218845] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-353" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.218959] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.219152] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.219284] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.219520] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.219670] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.219884] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 879.220021] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 879.220131] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 879.220242] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 879.220356] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 879.220456] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 879.220613] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 879.257887] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 879.258056] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 879.259786] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 879.259786] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-353" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.259786] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-a59ccbd4-85b3-4a98-8407-29d65fea21f5 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.259786] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-a59ccbd4-85b3-4a98-8407-29d65fea21f5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.259786] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-a59ccbd4-85b3-4a98-8407-29d65fea21f5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.259786] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-a59ccbd4-85b3-4a98-8407-29d65fea21f5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.259786] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a59ccbd4-85b3-4a98-8407-29d65fea21f5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.299995] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.300173] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.300260] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.300479] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.300576] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.300791] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.300889] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.300952] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.301163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.301221] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.301307] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c already deleted. [ 879.301401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.318935] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.318935] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.318935] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.318935] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.318935] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.318935] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 is going to be created. [ 879.331186] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b51e70d-5edb-4332-99e9-eb53e6015365: rpc.has_security_group_logging(os_id): False [ 879.341774] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.341984] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.342089] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.342346] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.342517] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.348821] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.349029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.349152] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.349392] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.349533] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.349767] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.349950] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.350123] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.350299] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.350434] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.350754] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.350910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.351025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.351224] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.351361] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.351611] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.351761] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.351865] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.352068] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.352200] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.352329] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 is going to be updated. [ 879.354301] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 in Status: UNINITIALIZED for 2s [ 879.413921] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.414186] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.414284] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.414528] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.414709] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.429427] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 in Status: IN_PROGRESS for 2s [ 879.508264] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.508264] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.508264] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.508264] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.508525] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.508525] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a65f6ee5-a363-4a90-a166-504360ba54b1 is going to be created. [ 879.511306] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.511435] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.511505] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.511687] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.511773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.511865] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d47d19df-e406-4c01-9cf0-1110c7c55440 is going to be updated. [ 879.542545] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.542737] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.542809] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.543043] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.543200] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.548395] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.548503] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.548543] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.548805] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.548943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.553416] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a65f6ee5-a363-4a90-a166-504360ba54b1 in Status: UNINITIALIZED for 2s [ 879.555902] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: IN_PROGRESS for 2s [ 879.763114] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.763114] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.763114] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.763308] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.763444] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.763700] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port a59ccbd4-85b3-4a98-8407-29d65fea21f5 not found, creating... [ 879.764341] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.764341] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.764341] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.764507] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.764656] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.765282] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.765282] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.765282] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.765465] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.765739] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.765930] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: a59ccbd4-85b3-4a98-8407-29d65fea21f5 is going to be created. [ 879.784844] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.784844] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.784844] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.785627] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.785944] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.786656] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-a59ccbd4-85b3-4a98-8407-29d65fea21f5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.754293] env[70013]: INFO networking_nsxv3.common.synchronization [req-77879ba3-0426-46b3-aaa2-e728628616ab req-c404ec91-2ff7-45b3-9a2f-e1bce2ded947 service nova] Enqueued Resource ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c with Priority: HIGHEST for action security_group_rules [ 880.754564] env[70013]: INFO networking_nsxv3.common.synchronization [req-77879ba3-0426-46b3-aaa2-e728628616ab req-c404ec91-2ff7-45b3-9a2f-e1bce2ded947 service nova] Enqueued Resource ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c with Priority: HIGHEST for action security_group_members [ 880.754778] env[70013]: INFO networking_nsxv3.common.synchronization [req-77879ba3-0426-46b3-aaa2-e728628616ab req-c404ec91-2ff7-45b3-9a2f-e1bce2ded947 service nova] Enqueued Resource ID: a59ccbd4-85b3-4a98-8407-29d65fea21f5 with Priority: HIGHEST for action port [ 880.757017] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c with Priority: HIGHEST for action security_group_rules [ 880.757017] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c with Priority: HIGHEST for action security_group_members [ 880.757017] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a59ccbd4-85b3-4a98-8407-29d65fea21f5 with Priority: HIGHEST for action port [ 880.757017] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.757017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.757017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.758156] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.758156] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca27a1b0-973f-4958-8f7f-a5c216cb9a8c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.761275] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.761275] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.761275] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.761533] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.764262] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.764262] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.764262] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.764262] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.764262] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.764262] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca27a1b0-973f-4958-8f7f-a5c216cb9a8c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.764819] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-a59ccbd4-85b3-4a98-8407-29d65fea21f5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.764819] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a59ccbd4-85b3-4a98-8407-29d65fea21f5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.764819] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a59ccbd4-85b3-4a98-8407-29d65fea21f5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.764819] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a59ccbd4-85b3-4a98-8407-29d65fea21f5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.764819] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a59ccbd4-85b3-4a98-8407-29d65fea21f5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.266862] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.267052] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.267219] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca27a1b0-973f-4958-8f7f-a5c216cb9a8c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.268297] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a59ccbd4-85b3-4a98-8407-29d65fea21f5 with status ACTIVE [ 881.268523] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.268943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.268943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.269125] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.269550] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.269550] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.269550] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.269949] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.269949] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.269949] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.270659] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.270824] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.270890] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.271121] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.271221] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.272157] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a59ccbd4-85b3-4a98-8407-29d65fea21f5 is going to be updated. [ 881.291500] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.291640] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.291717] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.291961] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.292155] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.292332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a59ccbd4-85b3-4a98-8407-29d65fea21f5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.364425] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 in Status: SUCCESS [ 881.364655] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.364831] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.365091] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.365283] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.365388] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.366918] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.366918] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.366918] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.366918] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.366918] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5ccee96a-c1fb-475b-86c3-7d4f1ccff166',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.444235] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 in Status: SUCCESS [ 881.444483] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.565468] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a65f6ee5-a363-4a90-a166-504360ba54b1 in Status: SUCCESS [ 881.569259] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.570552] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: SUCCESS [ 881.570552] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.571157] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.571238] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.571401] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.572230] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.572372] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.572631] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.572906] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.572906] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a65f6ee5-a363-4a90-a166-504360ba54b1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.574038] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.574038] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.574212] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.574606] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.574682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.574844] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.574950] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.575089] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.774231] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca27a1b0-973f-4958-8f7f-a5c216cb9a8c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.869358] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.869790] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.869790] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.869884] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.869995] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.870211] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.870211] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.870355] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.870418] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.870564] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.870757] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.870851] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.870935] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.871266] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.871266] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.871266] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.871366] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.871893] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.871989] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.876466] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.876696] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5ccee96a-c1fb-475b-86c3-7d4f1ccff166',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.077171] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a65f6ee5-a363-4a90-a166-504360ba54b1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.078186] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.278271] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.278506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.278618] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.278903] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.279037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.279162] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c is going to be created. [ 882.302735] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.302953] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.303033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.303282] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.303505] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.312311] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c in Status: UNINITIALIZED for 2s [ 882.380726] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5ccee96a-c1fb-475b-86c3-7d4f1ccff166: rpc.has_security_group_logging(os_id): False [ 882.399024] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.399402] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.399478] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.399690] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.399781] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.400029] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.400119] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.400187] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.400324] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.400625] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.400625] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.400744] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.400744] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.400840] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.400918] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.401107] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.401196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.401245] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.401386] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.401459] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.401543] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 is going to be created. [ 882.461270] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.461433] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.461516] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.462123] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.462123] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.472254] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 in Status: IN_PROGRESS for 2s [ 882.580739] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a65f6ee5-a363-4a90-a166-504360ba54b1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.584501] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.084059] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.084059] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.084059] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.084059] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.084561] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.084561] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a65f6ee5-a363-4a90-a166-504360ba54b1 is going to be updated. [ 883.086636] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.086636] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.086636] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.086636] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.086636] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.086636] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d47d19df-e406-4c01-9cf0-1110c7c55440 is going to be updated. [ 883.117718] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.117718] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.117718] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.117989] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.117989] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.120448] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.120448] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.120448] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.120448] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.120448] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.132590] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: IN_PROGRESS for 2s [ 883.133585] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a65f6ee5-a363-4a90-a166-504360ba54b1 in Status: IN_PROGRESS for 2s [ 883.607302] env[70013]: INFO networking_nsxv3.common.synchronization [req-7100d9e6-638e-4f44-a958-aca8ef9b0e1a req-82cedfa3-55af-4e7e-993d-bbc390dd1610 tempest-ServersNegativeTestJSON-128962351 tempest-ServersNegativeTestJSON-128962351-project-member] Enqueued Resource ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 with Priority: HIGHEST for action security_group_members [ 883.607981] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 with Priority: HIGHEST for action security_group_members [ 883.608430] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b51e70d-5edb-4332-99e9-eb53e6015365 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.608586] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.608659] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.608866] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.611717] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.611912] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.612763] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.613050] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.613638] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.613763] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.117905] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.321752] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c in Status: SUCCESS [ 884.322562] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.322804] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.323032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.323229] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.323349] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.323416] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.323576] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.323661] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.323765] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.323865] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca27a1b0-973f-4958-8f7f-a5c216cb9a8c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.483352] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 in Status: SUCCESS [ 884.484659] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.620840] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.803384] env[70013]: INFO networking_nsxv3.common.synchronization [req-f0bdabb6-0f8c-4c4b-8206-175e3833df84 req-f6c84c85-5ac2-43a3-a9e4-e01b99f3abb7 tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: 19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9 with Priority: HIGHEST for action security_group_members [ 884.803579] env[70013]: INFO networking_nsxv3.common.synchronization [req-f0bdabb6-0f8c-4c4b-8206-175e3833df84 req-f6c84c85-5ac2-43a3-a9e4-e01b99f3abb7 tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: a65f6ee5-a363-4a90-a166-504360ba54b1 with Priority: HIGHEST for action security_group_members [ 884.803749] env[70013]: INFO networking_nsxv3.common.synchronization [req-f0bdabb6-0f8c-4c4b-8206-175e3833df84 req-f6c84c85-5ac2-43a3-a9e4-e01b99f3abb7 tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_members [ 884.804345] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9 with Priority: HIGHEST for action security_group_members [ 884.804487] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a65f6ee5-a363-4a90-a166-504360ba54b1 with Priority: HIGHEST for action security_group_members [ 884.804589] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_members [ 884.804883] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.807041] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.807185] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.807487] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.807777] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.807949] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.807949] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.808071] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.808179] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.808286] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.809579] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a65f6ee5-a363-4a90-a166-504360ba54b1 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.809683] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.809879] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.809967] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.825793] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca27a1b0-973f-4958-8f7f-a5c216cb9a8c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.872088] env[70013]: INFO networking_nsxv3.common.synchronization [req-f0bdabb6-0f8c-4c4b-8206-175e3833df84 req-f6c84c85-5ac2-43a3-a9e4-e01b99f3abb7 tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: 19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9 with Priority: HIGHEST for action security_group_rules [ 884.872295] env[70013]: INFO networking_nsxv3.common.synchronization [req-f0bdabb6-0f8c-4c4b-8206-175e3833df84 req-f6c84c85-5ac2-43a3-a9e4-e01b99f3abb7 tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: 19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9 with Priority: HIGHEST for action security_group_members [ 884.872521] env[70013]: INFO networking_nsxv3.common.synchronization [req-f0bdabb6-0f8c-4c4b-8206-175e3833df84 req-f6c84c85-5ac2-43a3-a9e4-e01b99f3abb7 tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: a65f6ee5-a363-4a90-a166-504360ba54b1 with Priority: HIGHEST for action security_group_rules [ 884.872752] env[70013]: INFO networking_nsxv3.common.synchronization [req-f0bdabb6-0f8c-4c4b-8206-175e3833df84 req-f6c84c85-5ac2-43a3-a9e4-e01b99f3abb7 tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: a65f6ee5-a363-4a90-a166-504360ba54b1 with Priority: HIGHEST for action security_group_members [ 884.872907] env[70013]: INFO networking_nsxv3.common.synchronization [req-f0bdabb6-0f8c-4c4b-8206-175e3833df84 req-f6c84c85-5ac2-43a3-a9e4-e01b99f3abb7 tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_rules [ 884.873052] env[70013]: INFO networking_nsxv3.common.synchronization [req-f0bdabb6-0f8c-4c4b-8206-175e3833df84 req-f6c84c85-5ac2-43a3-a9e4-e01b99f3abb7 tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_members [ 884.873187] env[70013]: INFO networking_nsxv3.common.synchronization [req-f0bdabb6-0f8c-4c4b-8206-175e3833df84 req-f6c84c85-5ac2-43a3-a9e4-e01b99f3abb7 tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: d219e46c-ef15-4dec-a495-31e92d46d0c0 with Priority: HIGHEST for action port [ 884.873772] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9 with Priority: HIGHEST for action security_group_rules [ 884.873976] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a65f6ee5-a363-4a90-a166-504360ba54b1 with Priority: HIGHEST for action security_group_rules [ 884.874038] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_members [ 884.874145] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d219e46c-ef15-4dec-a495-31e92d46d0c0 with Priority: HIGHEST for action port [ 884.874245] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_rules [ 884.874341] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9 with Priority: HIGHEST for action security_group_members [ 884.874437] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a65f6ee5-a363-4a90-a166-504360ba54b1 with Priority: HIGHEST for action security_group_members [ 884.874992] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.875170] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.875244] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.875512] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.875603] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.877851] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a65f6ee5-a363-4a90-a166-504360ba54b1 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.877999] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.878194] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.878286] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.878525] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-d219e46c-ef15-4dec-a495-31e92d46d0c0 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.878574] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d219e46c-ef15-4dec-a495-31e92d46d0c0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.878635] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d219e46c-ef15-4dec-a495-31e92d46d0c0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.878892] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d219e46c-ef15-4dec-a495-31e92d46d0c0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.878930] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d219e46c-ef15-4dec-a495-31e92d46d0c0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.879829] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.879829] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.880041] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.880123] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.880319] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a65f6ee5-a363-4a90-a166-504360ba54b1 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.880405] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.124383] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.124383] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.124383] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.124383] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.124383] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.124802] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 is going to be updated. [ 885.142174] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a65f6ee5-a363-4a90-a166-504360ba54b1 in Status: IN_PROGRESS for 4s [ 885.142998] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: IN_PROGRESS for 4s [ 885.153479] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.153588] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.153743] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.155258] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.155258] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.160726] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 in Status: IN_PROGRESS for 2s [ 885.310871] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.327951] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca27a1b0-973f-4958-8f7f-a5c216cb9a8c: rpc.has_security_group_logging(os_id): False [ 885.345782] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.345922] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.346065] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.346221] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.346314] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.346556] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.346734] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.346734] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.346859] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.346939] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.347042] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c is going to be created. [ 885.384592] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.384592] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.384592] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d219e46c-ef15-4dec-a495-31e92d46d0c0 with status ACTIVE [ 885.384592] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.384592] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.384592] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.385260] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.385260] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.385260] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.385260] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.385436] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.385484] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.385571] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.385770] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.385880] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.385925] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.386122] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.386207] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.386295] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d219e46c-ef15-4dec-a495-31e92d46d0c0 is going to be updated. [ 885.410336] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.410567] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.410567] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.410873] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.411041] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.412868] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.413026] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.413087] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.413264] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.413369] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.413510] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d219e46c-ef15-4dec-a495-31e92d46d0c0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.423417] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c in Status: IN_PROGRESS for 2s [ 885.812947] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.317568] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.317890] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.317890] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.318034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.318123] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.318222] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9 is going to be created. [ 886.343379] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.343568] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.343622] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.343902] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.344648] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.356450] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9 in Status: UNINITIALIZED for 2s [ 887.153372] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a65f6ee5-a363-4a90-a166-504360ba54b1 in Status: SUCCESS [ 887.153560] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.153717] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.153947] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.154384] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.154384] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.154384] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.154563] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.154563] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.154693] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.154754] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a65f6ee5-a363-4a90-a166-504360ba54b1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.156140] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: SUCCESS [ 887.156322] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.156480] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.156631] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.156786] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.156891] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.156953] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.157117] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.157197] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.157298] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a65f6ee5-a363-4a90-a166-504360ba54b1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.158214] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.158214] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.158290] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.158389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.158446] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.158587] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.158662] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.158744] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.158832] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.159753] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.159938] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.160243] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.160243] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.160243] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.160435] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.160435] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.160580] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.169440] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 in Status: SUCCESS [ 887.169647] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.435180] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c in Status: SUCCESS [ 887.435474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.661498] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a65f6ee5-a363-4a90-a166-504360ba54b1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.661498] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a65f6ee5-a363-4a90-a166-504360ba54b1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.663162] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.663993] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.664315] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.052028] env[70013]: INFO networking_nsxv3.common.synchronization [req-b9a07698-27fb-4a3a-a88f-9308c931d907 req-ba171cac-0d7b-4a29-8f26-2598119c7b72 tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: 19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9 with Priority: HIGHEST for action security_group_members [ 888.052028] env[70013]: INFO networking_nsxv3.common.synchronization [req-b9a07698-27fb-4a3a-a88f-9308c931d907 req-ba171cac-0d7b-4a29-8f26-2598119c7b72 tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: a65f6ee5-a363-4a90-a166-504360ba54b1 with Priority: HIGHEST for action security_group_members [ 888.052028] env[70013]: INFO networking_nsxv3.common.synchronization [req-b9a07698-27fb-4a3a-a88f-9308c931d907 req-ba171cac-0d7b-4a29-8f26-2598119c7b72 tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_members [ 888.052028] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9 with Priority: HIGHEST for action security_group_members [ 888.052028] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a65f6ee5-a363-4a90-a166-504360ba54b1 with Priority: HIGHEST for action security_group_members [ 888.052028] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_members [ 888.052028] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.052028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.052028] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a65f6ee5-a363-4a90-a166-504360ba54b1 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.052028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.052028] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.052028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.165599] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a65f6ee5-a363-4a90-a166-504360ba54b1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.166675] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a65f6ee5-a363-4a90-a166-504360ba54b1: rpc.has_security_group_logging(os_id): False [ 888.167951] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.186865] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.187048] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.187102] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.187630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.187630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.187630] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.187790] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.187790] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.187966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.187966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.188059] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a65f6ee5-a363-4a90-a166-504360ba54b1 is going to be created. [ 888.211640] env[70013]: INFO networking_nsxv3.common.synchronization [None req-0a7fd3ac-18e1-49d5-97e8-2512a8135fbe tempest-AttachVolumeNegativeTest-680083968 tempest-AttachVolumeNegativeTest-680083968-project-member] Enqueued Resource ID: 0e60d03d-8d54-4827-87a6-1c1728f166fe with Priority: HIGHEST for action security_group_rules [ 888.211749] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e60d03d-8d54-4827-87a6-1c1728f166fe with Priority: HIGHEST for action security_group_rules [ 888.213163] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e60d03d-8d54-4827-87a6-1c1728f166fe taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.213163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.213163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.213163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.213163] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e60d03d-8d54-4827-87a6-1c1728f166fe',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.267844] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.267966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.268038] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.268272] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.268470] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.278679] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a65f6ee5-a363-4a90-a166-504360ba54b1 in Status: IN_PROGRESS for 2s [ 888.376657] env[70013]: INFO networking_nsxv3.common.synchronization [None req-04e763e0-5ed0-4c41-a00b-4338429dedd9 tempest-AttachVolumeNegativeTest-680083968 tempest-AttachVolumeNegativeTest-680083968-project-member] Enqueued Resource ID: 0e60d03d-8d54-4827-87a6-1c1728f166fe with Priority: HIGHEST for action security_group_rules [ 888.379956] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9 in Status: SUCCESS [ 888.379956] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.379956] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e60d03d-8d54-4827-87a6-1c1728f166fe with Priority: HIGHEST for action security_group_rules [ 888.379956] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.379956] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.379956] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.379956] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.379956] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.379956] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.379956] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.379956] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.380454] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e60d03d-8d54-4827-87a6-1c1728f166fe taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.380560] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.671069] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.671428] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.671428] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.671705] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.671705] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.672211] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a65f6ee5-a363-4a90-a166-504360ba54b1 is going to be updated. [ 888.673215] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.673336] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.673402] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.674826] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.674826] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.674826] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d47d19df-e406-4c01-9cf0-1110c7c55440 is going to be updated. [ 888.707475] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.707646] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.707685] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.707898] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.708070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.709789] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.709918] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.709986] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.713337] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.713559] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.727328] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a65f6ee5-a363-4a90-a166-504360ba54b1 in Status: IN_PROGRESS for 2s [ 888.728085] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: IN_PROGRESS for 2s [ 888.740604] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.740775] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.740864] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.741126] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.741240] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.741339] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e60d03d-8d54-4827-87a6-1c1728f166fe already deleted. [ 888.741426] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.741989] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.742205] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.742318] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e60d03d-8d54-4827-87a6-1c1728f166fe',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.885188] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.885412] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.885519] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.885779] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.885884] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.886467] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.886467] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.886467] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.886642] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.886642] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.886785] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9 is going to be deleted. [ 888.924482] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.924709] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.924759] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.925085] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.925205] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.925316] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.925496] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.925713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.925915] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.926034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.926119] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.926292] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.926381] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.926489] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.272632] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.272863] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.272911] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.273179] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.273295] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.273441] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e60d03d-8d54-4827-87a6-1c1728f166fe already deleted. [ 889.273558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.428450] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.428644] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.428708] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.429115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.429115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.429352] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.429425] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.429458] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.429595] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.429681] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.429808] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9 already deleted. [ 889.429910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.430026] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.430909] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.431892] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.432074] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.432375] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.432375] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.432506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.432555] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.432633] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.875891] env[70013]: INFO networking_nsxv3.common.synchronization [req-0a22edcd-1bc2-46e9-b13f-bc207188a3d5 req-3ece8df0-80ae-406b-ba68-17445a250880 tempest-ServersTestMultiNic-1935476789 tempest-ServersTestMultiNic-1935476789-project-member] Enqueued Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 889.882023] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 889.883266] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.883432] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.883539] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.888657] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.888657] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.888657] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.888657] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.889124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.889430] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.890528] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.935273] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.936405] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.936546] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.936595] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.936939] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.937031] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.937253] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.937349] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.937398] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.937531] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.937627] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.938117] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9 already deleted. [ 889.938117] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.248103] env[70013]: INFO networking_nsxv3.common.synchronization [req-0a22edcd-1bc2-46e9-b13f-bc207188a3d5 req-f736da13-6642-440a-8188-ac0925cf3b62 tempest-ServersTestMultiNic-1935476789 tempest-ServersTestMultiNic-1935476789-project-member] Enqueued Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 890.249100] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 890.250449] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.250553] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.292143] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a65f6ee5-a363-4a90-a166-504360ba54b1 in Status: SUCCESS [ 890.293080] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.293080] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.293080] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.293260] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a65f6ee5-a363-4a90-a166-504360ba54b1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.394148] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.394148] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.394148] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.394148] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.412420] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.412642] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.413156] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.413156] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.413156] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.413156] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.413294] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86efc288-b26f-4298-9444-58202b5c40d5 is going to be updated. [ 890.435788] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.439019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.439019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.439019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.439019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.439019] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9: rpc.has_security_group_logging(os_id): False [ 890.446139] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: IN_PROGRESS for 2s [ 890.481913] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.481913] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.481913] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.481913] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.481913] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.481913] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.481913] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.481913] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.481913] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.481913] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.481913] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9 is going to be created. [ 890.501035] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9], does not exist path=[/infra/domains/default/groups/19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9]."\n}' [ 890.501035] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9 [ 890.501035] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 890.534023] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.534023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.534023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.534023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.534023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.534542] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.534829] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.535025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.535296] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.535495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.535820] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.537825] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.537825] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.537825] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.537825] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.537825] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9 is going to be created. [ 890.554434] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9], does not exist path=[/infra/domains/default/groups/19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9 [ 890.558697] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.558697] env[70013]: Traceback (most recent call last): [ 890.558697] env[70013]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 890.558697] env[70013]: return func(*args, **kwargs) [ 890.558697] env[70013]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 890.558697] env[70013]: res.raise_for_status() [ 890.558697] env[70013]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 890.558697] env[70013]: raise HTTPError(http_error_msg, response=self) [ 890.558697] env[70013]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9 [ 890.558697] env[70013]: During handling of the above exception, another exception occurred: [ 890.558697] env[70013]: Traceback (most recent call last): [ 890.558697] env[70013]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 890.558697] env[70013]: listener.cb(fileno) [ 890.558697] env[70013]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 890.558697] env[70013]: result = function(*args, **kwargs) [ 890.558697] env[70013]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 890.558697] env[70013]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 890.558697] env[70013]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 890.558697] env[70013]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 890.558697] env[70013]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 890.558697] env[70013]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 890.558697] env[70013]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 890.558697] env[70013]: res.raise_for_status() [ 890.558697] env[70013]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 890.558697] env[70013]: raise HTTPError(http_error_msg, response=self) [ 890.558697] env[70013]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/19a82ef8-a9f5-4d44-a61e-0e19f29c5fb9 [ 890.558697] env[70013]: Removing descriptor: 67 [ 890.603093] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-130 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.603093] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-130" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.603093] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-130" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.603093] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-130" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.603093] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.603093] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.603093] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.603093] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.603685] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.604074] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 890.604347] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 890.604592] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 890.604827] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 890.605085] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 890.605327] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 890.605605] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 890.625120] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 890.625120] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 890.625120] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 890.625120] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-130" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.625120] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-b41c227c-d57d-4d37-a05c-24351d6d22f1 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.625120] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-b41c227c-d57d-4d37-a05c-24351d6d22f1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.625120] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-b41c227c-d57d-4d37-a05c-24351d6d22f1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.625120] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-b41c227c-d57d-4d37-a05c-24351d6d22f1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.625120] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b41c227c-d57d-4d37-a05c-24351d6d22f1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.740267] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a65f6ee5-a363-4a90-a166-504360ba54b1 in Status: SUCCESS [ 890.740440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.741515] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: SUCCESS [ 890.741689] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.742557] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.742851] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.743210] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.743381] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.743959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.743959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.743959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.743959] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a65f6ee5-a363-4a90-a166-504360ba54b1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.745731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.746063] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.746785] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.746785] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.746955] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.747481] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.747481] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.747481] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.817138] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.817465] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.817555] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.817757] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.833310] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.833409] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a65f6ee5-a363-4a90-a166-504360ba54b1 is going to be deleted. [ 890.880065] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.880475] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.880475] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.880661] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.880820] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.880980] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.128517] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.128517] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.128517] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.128517] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.128517] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.128736] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port b41c227c-d57d-4d37-a05c-24351d6d22f1 not found, creating... [ 891.128914] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.129082] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.129206] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.129422] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.129564] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.129984] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.130419] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.130419] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.130419] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.130897] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.130897] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: b41c227c-d57d-4d37-a05c-24351d6d22f1 is going to be created. [ 891.154046] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.154046] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.154046] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.154046] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.154046] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.154046] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-b41c227c-d57d-4d37-a05c-24351d6d22f1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.252394] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.252394] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.252394] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.252394] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.252394] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.252394] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.252394] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.252394] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.252394] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.252394] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.252394] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a65f6ee5-a363-4a90-a166-504360ba54b1 is going to be deleted. [ 891.252394] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.289025] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.289025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.289025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.289025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.289025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.289025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.289025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.289025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.289025] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.289025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.289025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.289025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.289025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.289025] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a65f6ee5-a363-4a90-a166-504360ba54b1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.754674] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.791381] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.791511] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.791511] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.791706] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.791794] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.792043] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.792135] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.792199] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.792349] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.792422] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.792505] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a65f6ee5-a363-4a90-a166-504360ba54b1 already deleted. [ 891.792579] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a65f6ee5-a363-4a90-a166-504360ba54b1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.151882] env[70013]: INFO networking_nsxv3.common.synchronization [req-0a22edcd-1bc2-46e9-b13f-bc207188a3d5 req-9d8ffcef-c835-4f83-bb44-74f7c99c55d7 service nova] Enqueued Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_rules [ 892.152142] env[70013]: INFO networking_nsxv3.common.synchronization [req-0a22edcd-1bc2-46e9-b13f-bc207188a3d5 req-9d8ffcef-c835-4f83-bb44-74f7c99c55d7 service nova] Enqueued Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 892.152232] env[70013]: INFO networking_nsxv3.common.synchronization [req-0a22edcd-1bc2-46e9-b13f-bc207188a3d5 req-9d8ffcef-c835-4f83-bb44-74f7c99c55d7 service nova] Enqueued Resource ID: b41c227c-d57d-4d37-a05c-24351d6d22f1 with Priority: HIGHEST for action port [ 892.152492] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_rules [ 892.152587] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 892.152682] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b41c227c-d57d-4d37-a05c-24351d6d22f1 with Priority: HIGHEST for action port [ 892.153331] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.153443] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.153509] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.153714] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.153811] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.154728] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.154846] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.155087] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-b41c227c-d57d-4d37-a05c-24351d6d22f1 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.155186] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b41c227c-d57d-4d37-a05c-24351d6d22f1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.155252] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b41c227c-d57d-4d37-a05c-24351d6d22f1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.155442] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b41c227c-d57d-4d37-a05c-24351d6d22f1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.155552] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b41c227c-d57d-4d37-a05c-24351d6d22f1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.257200] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.257414] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.257414] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.257645] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.257725] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.257830] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d47d19df-e406-4c01-9cf0-1110c7c55440 is going to be updated. [ 892.286472] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.286472] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.286472] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.286472] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.286472] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.298876] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: IN_PROGRESS for 2s [ 892.455352] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: SUCCESS [ 892.456451] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86efc288-b26f-4298-9444-58202b5c40d5 deletion is rescheduled due to dependency. [ 892.456451] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.456451] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.456451] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.456451] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.456451] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.456451] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.457023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.457023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.457023] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.658744] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.658877] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.659109] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b41c227c-d57d-4d37-a05c-24351d6d22f1 with status ACTIVE [ 892.659297] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.659417] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.659463] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.659674] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.659772] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.659941] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.660053] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.660117] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.660270] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.660348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.660528] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.660621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.660683] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.660816] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.660890] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.660972] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b41c227c-d57d-4d37-a05c-24351d6d22f1 is going to be updated. [ 892.696842] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.697773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.697773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.698642] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.698913] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.699329] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b41c227c-d57d-4d37-a05c-24351d6d22f1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.966606] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.056035] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-550 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.056035] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-550" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.056207] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-550" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.056469] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-550" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.056955] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.056955] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.057107] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.057270] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.057416] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.057624] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 893.057740] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 893.057852] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 893.057961] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 893.058491] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 893.058722] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 893.058886] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 893.076193] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 893.076376] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 893.076521] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 893.076704] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-550" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.077028] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-926fd7e2-c562-49a2-9146-1c38fc20e80a taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.077211] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-926fd7e2-c562-49a2-9146-1c38fc20e80a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.077332] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-926fd7e2-c562-49a2-9146-1c38fc20e80a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.077675] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-926fd7e2-c562-49a2-9146-1c38fc20e80a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.077820] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('926fd7e2-c562-49a2-9146-1c38fc20e80a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.147388] env[70013]: INFO networking_nsxv3.common.synchronization [None req-dfb75cb6-5b4e-4b81-8d69-3838868bea2e tempest-AttachVolumeTestJSON-972861423 tempest-AttachVolumeTestJSON-972861423-project-member] Enqueued Resource ID: f3b902d5-ffa1-4a45-b449-3b726cf76855 with Priority: HIGHEST for action security_group_rules [ 893.148217] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b902d5-ffa1-4a45-b449-3b726cf76855 with Priority: HIGHEST for action security_group_rules [ 893.148597] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3b902d5-ffa1-4a45-b449-3b726cf76855 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.148770] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.148862] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.149155] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.149275] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3b902d5-ffa1-4a45-b449-3b726cf76855',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.285654] env[70013]: INFO networking_nsxv3.common.synchronization [None req-2c0e49bc-d140-4a1f-8662-fb5dbf18846d tempest-AttachVolumeTestJSON-972861423 tempest-AttachVolumeTestJSON-972861423-project-member] Enqueued Resource ID: f3b902d5-ffa1-4a45-b449-3b726cf76855 with Priority: HIGHEST for action security_group_rules [ 893.286174] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b902d5-ffa1-4a45-b449-3b726cf76855 with Priority: HIGHEST for action security_group_rules [ 893.286492] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3b902d5-ffa1-4a45-b449-3b726cf76855 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.286597] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.469057] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.582407] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.582638] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.582846] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.583170] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.583334] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.583494] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 926fd7e2-c562-49a2-9146-1c38fc20e80a not found, creating... [ 893.583805] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.583984] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.584121] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.584344] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.584487] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.584775] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.584932] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.585118] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.585346] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.585483] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.585624] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 926fd7e2-c562-49a2-9146-1c38fc20e80a is going to be created. [ 893.607086] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.607086] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.607086] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.607296] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.607561] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.607792] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-926fd7e2-c562-49a2-9146-1c38fc20e80a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.671784] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.671946] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.671946] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.672218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.672218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.672277] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3b902d5-ffa1-4a45-b449-3b726cf76855 already deleted. [ 893.672393] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.672723] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.672723] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.672852] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3b902d5-ffa1-4a45-b449-3b726cf76855',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.972903] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.973128] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.973238] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.973486] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.973618] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.973762] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86efc288-b26f-4298-9444-58202b5c40d5 is going to be updated. [ 894.002339] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.002486] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.002954] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.002954] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.002954] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.013111] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: IN_PROGRESS for 2s [ 894.195912] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.196459] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.196459] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.196459] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.196459] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.196616] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3b902d5-ffa1-4a45-b449-3b726cf76855 already deleted. [ 894.196616] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.309570] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: SUCCESS [ 894.309810] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.310606] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.310884] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.311099] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.311222] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.311290] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.311458] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.311561] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.311652] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.311815] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.311899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.311960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.312113] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.312250] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.312345] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.312408] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.312544] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.312620] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.312700] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.312812] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.313885] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.314072] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.314224] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.314322] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.314385] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.314526] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.314604] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.314693] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.591172] env[70013]: INFO networking_nsxv3.common.synchronization [req-0a22edcd-1bc2-46e9-b13f-bc207188a3d5 req-600c50ad-13c6-4aa6-9993-24e39a874e4e service nova] Enqueued Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_rules [ 894.591172] env[70013]: INFO networking_nsxv3.common.synchronization [req-0a22edcd-1bc2-46e9-b13f-bc207188a3d5 req-600c50ad-13c6-4aa6-9993-24e39a874e4e service nova] Enqueued Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 894.591172] env[70013]: INFO networking_nsxv3.common.synchronization [req-0a22edcd-1bc2-46e9-b13f-bc207188a3d5 req-600c50ad-13c6-4aa6-9993-24e39a874e4e service nova] Enqueued Resource ID: 926fd7e2-c562-49a2-9146-1c38fc20e80a with Priority: HIGHEST for action port [ 894.591172] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_rules [ 894.591172] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 894.591172] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 926fd7e2-c562-49a2-9146-1c38fc20e80a with Priority: HIGHEST for action port [ 894.591172] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.591172] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.591817] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.592049] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.592360] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-926fd7e2-c562-49a2-9146-1c38fc20e80a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.592704] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-926fd7e2-c562-49a2-9146-1c38fc20e80a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.593035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-926fd7e2-c562-49a2-9146-1c38fc20e80a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.593424] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-926fd7e2-c562-49a2-9146-1c38fc20e80a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.593702] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('926fd7e2-c562-49a2-9146-1c38fc20e80a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.755459] env[70013]: INFO networking_nsxv3.common.synchronization [req-f6ca5bd7-49fa-4368-9e8a-1a667abea13b req-7f515e4e-b865-4e30-9caa-79bafc3805de tempest-ServerActionsV293TestJSON-1916911121 tempest-ServerActionsV293TestJSON-1916911121-project-member] Enqueued Resource ID: 48314c78-ef82-4312-9437-4a43cc3de63d with Priority: HIGHEST for action security_group_members [ 894.756025] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48314c78-ef82-4312-9437-4a43cc3de63d with Priority: HIGHEST for action security_group_members [ 894.756336] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-48314c78-ef82-4312-9437-4a43cc3de63d taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.756485] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-48314c78-ef82-4312-9437-4a43cc3de63d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.756528] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-48314c78-ef82-4312-9437-4a43cc3de63d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.756731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-48314c78-ef82-4312-9437-4a43cc3de63d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.756875] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.757062] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.757912] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.757912] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.758124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.758124] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('48314c78-ef82-4312-9437-4a43cc3de63d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.817197] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d47d19df-e406-4c01-9cf0-1110c7c55440: rpc.has_security_group_logging(os_id): False [ 894.818448] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.840463] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.840835] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.840835] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.840935] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.866066] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.867305] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.867305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.867462] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.867549] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.867630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.867835] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.867970] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.868017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.868149] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.868224] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.868403] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.868496] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.868559] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.868699] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.868777] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.868900] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d47d19df-e406-4c01-9cf0-1110c7c55440 is going to be updated. [ 894.926544] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.926700] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.926771] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.927105] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.927264] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.941796] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: IN_PROGRESS for 2s [ 895.096659] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 926fd7e2-c562-49a2-9146-1c38fc20e80a with status ACTIVE [ 895.096944] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.097119] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.097209] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.097417] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.097510] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.097716] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.097829] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.097893] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.098062] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.098140] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.098355] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.098457] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.098530] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.098702] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.098790] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.098887] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 926fd7e2-c562-49a2-9146-1c38fc20e80a is going to be updated. [ 895.119157] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.119370] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.119431] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.119691] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.119872] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.120137] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-926fd7e2-c562-49a2-9146-1c38fc20e80a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.242012] env[70013]: INFO networking_nsxv3.common.synchronization [req-203e4e8e-5e02-4219-96b6-0d1e0dd3b67b req-f89ecbbb-7787-4cf3-9926-5ae8340f0ffc tempest-MultipleCreateTestJSON-634477930 tempest-MultipleCreateTestJSON-634477930-project-member] Enqueued Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_members [ 895.242012] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_members [ 895.242012] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.242012] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.242012] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.242012] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.242012] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.242012] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.242012] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.242988] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.243340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.244040] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.262194] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.262348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.262419] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.262619] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.297340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.297340] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.297340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.297340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.297340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.297340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.297340] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48314c78-ef82-4312-9437-4a43cc3de63d is going to be updated. [ 895.322875] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.324722] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.324722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.325034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.325034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.326427] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.335911] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48314c78-ef82-4312-9437-4a43cc3de63d in Status: IN_PROGRESS for 2s [ 895.720386] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-269 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.720580] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-269" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.720703] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-269" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.720970] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-269" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.721278] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.722290] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.722963] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.723376] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.723743] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.724908] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 895.725243] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 895.725809] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 895.726020] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 895.726176] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 895.726296] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 895.726443] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 895.749258] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 895.749258] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 895.749258] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 895.749258] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-269" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.749258] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-6d51b5bb-0659-4302-96ab-4991ce36e722 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.749598] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-6d51b5bb-0659-4302-96ab-4991ce36e722" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.749598] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-6d51b5bb-0659-4302-96ab-4991ce36e722" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.749841] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-6d51b5bb-0659-4302-96ab-4991ce36e722" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.749911] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d51b5bb-0659-4302-96ab-4991ce36e722',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.753447] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.753447] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.753544] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.753782] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.793765] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.794035] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.794621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.794621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.794621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.794621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.794621] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b is going to be updated. [ 895.818764] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.818764] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.818764] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.818764] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.818764] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.827473] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: IN_PROGRESS for 2s [ 895.827691] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.827904] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.828077] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.828584] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.828584] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.828584] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d47d19df-e406-4c01-9cf0-1110c7c55440 is going to be updated. [ 895.853512] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.853694] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.853770] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.853995] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.854155] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.863499] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: IN_PROGRESS for 2s [ 896.020690] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: SUCCESS [ 896.023233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.023233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.023233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.023233] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.023233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.023233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.023233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.023233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.023233] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.254361] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.254650] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.254785] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.255218] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.255415] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.255603] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 6d51b5bb-0659-4302-96ab-4991ce36e722 not found, creating... [ 896.255917] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.256129] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.256267] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.256537] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.256753] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.257171] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.257392] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.257541] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.257832] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.258009] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.258347] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 6d51b5bb-0659-4302-96ab-4991ce36e722 is going to be created. [ 896.280513] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.280853] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.281068] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.281429] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.281723] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.282015] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-6d51b5bb-0659-4302-96ab-4991ce36e722" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.529500] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.960577] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: SUCCESS [ 896.960879] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.961025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.961256] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.961340] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.979137] env[70013]: INFO networking_nsxv3.common.synchronization [req-c976cbc9-97d6-437b-b940-b2312e33ece1 req-d1da2aa0-c8be-4b7c-b51a-4044752d60d8 tempest-ServerRescueTestJSONUnderV235-1838383190 tempest-ServerRescueTestJSONUnderV235-1838383190-project-member] Enqueued Resource ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 with Priority: HIGHEST for action security_group_members [ 896.979353] env[70013]: INFO networking_nsxv3.common.synchronization [req-c976cbc9-97d6-437b-b940-b2312e33ece1 req-d1da2aa0-c8be-4b7c-b51a-4044752d60d8 tempest-ServerRescueTestJSONUnderV235-1838383190 tempest-ServerRescueTestJSONUnderV235-1838383190-project-member] Enqueued Resource ID: d933f6d4-22a1-406c-b3f4-f69901535e42 with Priority: HIGHEST for action security_group_members [ 896.980821] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 with Priority: HIGHEST for action security_group_members [ 896.980937] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d933f6d4-22a1-406c-b3f4-f69901535e42 with Priority: HIGHEST for action security_group_members [ 896.982405] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.982527] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.982592] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.982815] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.983219] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.983219] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.983219] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.983379] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.983461] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.983627] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ccee96a-c1fb-475b-86c3-7d4f1ccff166',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.984523] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d933f6d4-22a1-406c-b3f4-f69901535e42 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.984523] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d933f6d4-22a1-406c-b3f4-f69901535e42" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.984674] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d933f6d4-22a1-406c-b3f4-f69901535e42" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.984779] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d933f6d4-22a1-406c-b3f4-f69901535e42" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.984925] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.985021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.985082] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.985218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.985310] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.985431] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d933f6d4-22a1-406c-b3f4-f69901535e42',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.031734] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.048152] env[70013]: INFO networking_nsxv3.common.synchronization [req-c976cbc9-97d6-437b-b940-b2312e33ece1 req-d1da2aa0-c8be-4b7c-b51a-4044752d60d8 tempest-ServerRescueTestJSONUnderV235-1838383190 tempest-ServerRescueTestJSONUnderV235-1838383190-project-member] Enqueued Resource ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 with Priority: HIGHEST for action security_group_rules [ 897.048152] env[70013]: INFO networking_nsxv3.common.synchronization [req-c976cbc9-97d6-437b-b940-b2312e33ece1 req-d1da2aa0-c8be-4b7c-b51a-4044752d60d8 tempest-ServerRescueTestJSONUnderV235-1838383190 tempest-ServerRescueTestJSONUnderV235-1838383190-project-member] Enqueued Resource ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 with Priority: HIGHEST for action security_group_members [ 897.048152] env[70013]: INFO networking_nsxv3.common.synchronization [req-c976cbc9-97d6-437b-b940-b2312e33ece1 req-d1da2aa0-c8be-4b7c-b51a-4044752d60d8 tempest-ServerRescueTestJSONUnderV235-1838383190 tempest-ServerRescueTestJSONUnderV235-1838383190-project-member] Enqueued Resource ID: d933f6d4-22a1-406c-b3f4-f69901535e42 with Priority: HIGHEST for action security_group_rules [ 897.048152] env[70013]: INFO networking_nsxv3.common.synchronization [req-c976cbc9-97d6-437b-b940-b2312e33ece1 req-d1da2aa0-c8be-4b7c-b51a-4044752d60d8 tempest-ServerRescueTestJSONUnderV235-1838383190 tempest-ServerRescueTestJSONUnderV235-1838383190-project-member] Enqueued Resource ID: d933f6d4-22a1-406c-b3f4-f69901535e42 with Priority: HIGHEST for action security_group_members [ 897.048152] env[70013]: INFO networking_nsxv3.common.synchronization [req-c976cbc9-97d6-437b-b940-b2312e33ece1 req-d1da2aa0-c8be-4b7c-b51a-4044752d60d8 tempest-ServerRescueTestJSONUnderV235-1838383190 tempest-ServerRescueTestJSONUnderV235-1838383190-project-member] Enqueued Resource ID: 759215b2-ed99-4281-9bf0-fb9379eab835 with Priority: HIGHEST for action port [ 897.049598] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 with Priority: HIGHEST for action security_group_rules [ 897.049895] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d933f6d4-22a1-406c-b3f4-f69901535e42 with Priority: HIGHEST for action security_group_rules [ 897.050013] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 759215b2-ed99-4281-9bf0-fb9379eab835 with Priority: HIGHEST for action port [ 897.050114] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 with Priority: HIGHEST for action security_group_members [ 897.050219] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d933f6d4-22a1-406c-b3f4-f69901535e42 with Priority: HIGHEST for action security_group_members [ 897.052936] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ccee96a-c1fb-475b-86c3-7d4f1ccff166 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.052936] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.052936] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.052936] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.052936] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ccee96a-c1fb-475b-86c3-7d4f1ccff166',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.052936] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d933f6d4-22a1-406c-b3f4-f69901535e42 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.052936] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d933f6d4-22a1-406c-b3f4-f69901535e42" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.052936] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d933f6d4-22a1-406c-b3f4-f69901535e42" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.052936] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d933f6d4-22a1-406c-b3f4-f69901535e42" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.052936] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d933f6d4-22a1-406c-b3f4-f69901535e42',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.055288] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-759215b2-ed99-4281-9bf0-fb9379eab835 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.055288] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-759215b2-ed99-4281-9bf0-fb9379eab835" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.055288] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-759215b2-ed99-4281-9bf0-fb9379eab835" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.055288] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-759215b2-ed99-4281-9bf0-fb9379eab835" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.055288] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('759215b2-ed99-4281-9bf0-fb9379eab835',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.055288] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.055742] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.055742] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d933f6d4-22a1-406c-b3f4-f69901535e42 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.055742] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d933f6d4-22a1-406c-b3f4-f69901535e42" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.209664] env[70013]: INFO networking_nsxv3.common.synchronization [req-203e4e8e-5e02-4219-96b6-0d1e0dd3b67b req-27136e48-cab9-4c36-96d2-5d21f0052bd3 service nova] Enqueued Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_rules [ 897.209870] env[70013]: INFO networking_nsxv3.common.synchronization [req-203e4e8e-5e02-4219-96b6-0d1e0dd3b67b req-27136e48-cab9-4c36-96d2-5d21f0052bd3 service nova] Enqueued Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_members [ 897.209990] env[70013]: INFO networking_nsxv3.common.synchronization [req-203e4e8e-5e02-4219-96b6-0d1e0dd3b67b req-27136e48-cab9-4c36-96d2-5d21f0052bd3 service nova] Enqueued Resource ID: 6d51b5bb-0659-4302-96ab-4991ce36e722 with Priority: HIGHEST for action port [ 897.210258] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_rules [ 897.210522] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_members [ 897.210522] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d51b5bb-0659-4302-96ab-4991ce36e722 with Priority: HIGHEST for action port [ 897.211336] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.214048] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.214123] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.214341] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.214415] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.215349] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.215491] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.215750] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d51b5bb-0659-4302-96ab-4991ce36e722 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.215813] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d51b5bb-0659-4302-96ab-4991ce36e722" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.215883] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d51b5bb-0659-4302-96ab-4991ce36e722" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.216089] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d51b5bb-0659-4302-96ab-4991ce36e722" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.216226] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d51b5bb-0659-4302-96ab-4991ce36e722',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.345666] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 48314c78-ef82-4312-9437-4a43cc3de63d in Status: SUCCESS [ 897.345963] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 48314c78-ef82-4312-9437-4a43cc3de63d deletion is rescheduled due to dependency. [ 897.345963] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-48314c78-ef82-4312-9437-4a43cc3de63d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.467579] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.467579] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.490739] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d933f6d4-22a1-406c-b3f4-f69901535e42',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.490917] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5ccee96a-c1fb-475b-86c3-7d4f1ccff166',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.536065] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.537814] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.537814] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.537814] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.537814] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.537814] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86efc288-b26f-4298-9444-58202b5c40d5 is going to be updated. [ 897.560025] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.560025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.560025] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d933f6d4-22a1-406c-b3f4-f69901535e42 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.560025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d933f6d4-22a1-406c-b3f4-f69901535e42" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.560025] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 759215b2-ed99-4281-9bf0-fb9379eab835 with status ACTIVE [ 897.560025] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.560025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.560025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.560025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.560025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.560025] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.560025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.560025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.560025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.560025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.560842] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.560842] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.560842] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.560842] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.560842] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.560842] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 759215b2-ed99-4281-9bf0-fb9379eab835 is going to be updated. [ 897.568044] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.568044] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.568044] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.568044] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.568044] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.576742] env[70013]: INFO networking_nsxv3.common.synchronization [req-5cf7f0af-ef61-43d4-89eb-4d1d6cedf74b req-49567f8d-ddcb-448b-b03f-215a249d3603 tempest-ServerRescueTestJSONUnderV235-1838383190 tempest-ServerRescueTestJSONUnderV235-1838383190-project-member] Enqueued Resource ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 with Priority: HIGHEST for action security_group_members [ 897.576742] env[70013]: INFO networking_nsxv3.common.synchronization [req-5cf7f0af-ef61-43d4-89eb-4d1d6cedf74b req-49567f8d-ddcb-448b-b03f-215a249d3603 tempest-ServerRescueTestJSONUnderV235-1838383190 tempest-ServerRescueTestJSONUnderV235-1838383190-project-member] Enqueued Resource ID: d933f6d4-22a1-406c-b3f4-f69901535e42 with Priority: HIGHEST for action security_group_members [ 897.576742] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 with Priority: HIGHEST for action security_group_members [ 897.576742] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d933f6d4-22a1-406c-b3f4-f69901535e42 with Priority: HIGHEST for action security_group_members [ 897.576742] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.576742] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.577220] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d933f6d4-22a1-406c-b3f4-f69901535e42 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.577220] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d933f6d4-22a1-406c-b3f4-f69901535e42" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.577635] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: IN_PROGRESS for 2s [ 897.593940] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.594115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.594189] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.594402] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.594539] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.594698] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-759215b2-ed99-4281-9bf0-fb9379eab835" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.633837] env[70013]: INFO networking_nsxv3.common.synchronization [req-5cf7f0af-ef61-43d4-89eb-4d1d6cedf74b req-49567f8d-ddcb-448b-b03f-215a249d3603 tempest-ServerRescueTestJSONUnderV235-1838383190 tempest-ServerRescueTestJSONUnderV235-1838383190-project-member] Enqueued Resource ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 with Priority: HIGHEST for action security_group_rules [ 897.634112] env[70013]: INFO networking_nsxv3.common.synchronization [req-5cf7f0af-ef61-43d4-89eb-4d1d6cedf74b req-49567f8d-ddcb-448b-b03f-215a249d3603 tempest-ServerRescueTestJSONUnderV235-1838383190 tempest-ServerRescueTestJSONUnderV235-1838383190-project-member] Enqueued Resource ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 with Priority: HIGHEST for action security_group_members [ 897.634230] env[70013]: INFO networking_nsxv3.common.synchronization [req-5cf7f0af-ef61-43d4-89eb-4d1d6cedf74b req-49567f8d-ddcb-448b-b03f-215a249d3603 tempest-ServerRescueTestJSONUnderV235-1838383190 tempest-ServerRescueTestJSONUnderV235-1838383190-project-member] Enqueued Resource ID: 759215b2-ed99-4281-9bf0-fb9379eab835 with Priority: HIGHEST for action port [ 897.634753] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 with Priority: HIGHEST for action security_group_rules [ 897.634878] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 with Priority: HIGHEST for action security_group_members [ 897.634973] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 759215b2-ed99-4281-9bf0-fb9379eab835 with Priority: HIGHEST for action port [ 897.635839] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ccee96a-c1fb-475b-86c3-7d4f1ccff166 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.635839] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.635839] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.636075] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.636305] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-759215b2-ed99-4281-9bf0-fb9379eab835 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.636655] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-759215b2-ed99-4281-9bf0-fb9379eab835" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.636755] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-759215b2-ed99-4281-9bf0-fb9379eab835" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.636987] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-759215b2-ed99-4281-9bf0-fb9379eab835" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.640876] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('759215b2-ed99-4281-9bf0-fb9379eab835',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.718892] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.718892] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.722137] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d51b5bb-0659-4302-96ab-4991ce36e722 with status ACTIVE [ 897.722471] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.722730] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.726017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.726017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.726017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.726017] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.726017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.726017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.726017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.726017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.726017] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.726017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.726017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.726017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.726017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.726017] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d51b5bb-0659-4302-96ab-4991ce36e722 is going to be updated. [ 897.750531] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.750663] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.750713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.750950] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.751125] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.751364] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d51b5bb-0659-4302-96ab-4991ce36e722" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.843994] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: SUCCESS [ 897.844266] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b deletion is rescheduled due to dependency. [ 897.844387] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.844576] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.844833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.845067] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.845261] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.845333] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.845630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.845630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.845766] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.876767] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: SUCCESS [ 897.877057] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.877223] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.877453] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.878677] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.878677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.878677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.878677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.878677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.878677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.878677] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.996032] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d933f6d4-22a1-406c-b3f4-f69901535e42',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.997113] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5ccee96a-c1fb-475b-86c3-7d4f1ccff166',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.144636] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 759215b2-ed99-4281-9bf0-fb9379eab835 with status ACTIVE [ 898.144926] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.145147] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.145282] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.145529] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.145696] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.145874] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.146085] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.146085] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.146279] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.146387] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.146593] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.146844] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.146844] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.146992] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.147033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.147175] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 759215b2-ed99-4281-9bf0-fb9379eab835 is going to be updated. [ 898.170978] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.170978] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.170978] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.170978] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.171243] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.171375] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-759215b2-ed99-4281-9bf0-fb9379eab835" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.351423] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.381953] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.381953] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.381953] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.382191] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.382396] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.382517] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.382585] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.384078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.384078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.384078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.384078] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.384078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.384078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.384078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.384078] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.384078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.384078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.384078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.384078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.384678] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.384678] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.501109] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.501109] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.501109] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.501109] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.501109] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.501109] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d933f6d4-22a1-406c-b3f4-f69901535e42 is going to be created. [ 898.502135] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.502400] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.502601] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.502898] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.503121] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.503304] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 is going to be updated. [ 898.525061] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.525925] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.528020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.528020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.528020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.528545] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.528784] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.528938] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.529193] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.529415] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.547089] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d933f6d4-22a1-406c-b3f4-f69901535e42 in Status: UNINITIALIZED for 2s [ 898.547089] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 in Status: IN_PROGRESS for 2s [ 898.855076] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.886374] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d47d19df-e406-4c01-9cf0-1110c7c55440: rpc.has_security_group_logging(os_id): False [ 898.904033] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.904210] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.904210] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.904358] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.904802] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.905089] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.905219] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.905292] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.905461] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.905547] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.905749] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.905943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.906245] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.906419] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.906502] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.906696] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.906793] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.906870] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.907157] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.907157] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.907261] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d47d19df-e406-4c01-9cf0-1110c7c55440 is going to be updated. [ 898.962215] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.962421] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.962486] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.962716] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.963285] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.975396] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: IN_PROGRESS for 2s [ 899.358483] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.358483] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.358483] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.358483] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.358738] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.358738] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b is going to be updated. [ 899.387069] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.387436] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.387436] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.387653] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.387760] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.420399] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: IN_PROGRESS for 2s [ 899.594130] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: SUCCESS [ 899.594362] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.595433] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.595433] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.595433] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.595433] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.595433] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.595433] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.595433] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.595692] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.595692] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.596609] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.596727] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.596909] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.597221] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.597221] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.597304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.597304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.597470] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.099210] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.099339] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.103043] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.557219] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d933f6d4-22a1-406c-b3f4-f69901535e42 in Status: SUCCESS [ 900.557547] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d933f6d4-22a1-406c-b3f4-f69901535e42" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.557823] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d933f6d4-22a1-406c-b3f4-f69901535e42" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.558361] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d933f6d4-22a1-406c-b3f4-f69901535e42" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.558457] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.558550] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.558660] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.558872] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.559048] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.559109] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d933f6d4-22a1-406c-b3f4-f69901535e42',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.560656] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 in Status: SUCCESS [ 900.560910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.561183] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.561466] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.561547] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.561615] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.561662] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.561801] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.561878] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.561965] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ccee96a-c1fb-475b-86c3-7d4f1ccff166',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.606611] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.765908] env[70013]: INFO networking_nsxv3.common.synchronization [None req-ae127b9c-3e74-4d6c-87d2-2ca988f1ba59 None None] Enqueued Resource ID: b16501ca-f12e-452b-84e5-e293f53d7ebd with Priority: HIGHEST for action port [ 900.766647] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b16501ca-f12e-452b-84e5-e293f53d7ebd with Priority: HIGHEST for action port [ 900.767016] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-b16501ca-f12e-452b-84e5-e293f53d7ebd taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.768427] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b16501ca-f12e-452b-84e5-e293f53d7ebd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.768507] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b16501ca-f12e-452b-84e5-e293f53d7ebd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.768771] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b16501ca-f12e-452b-84e5-e293f53d7ebd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.768863] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b16501ca-f12e-452b-84e5-e293f53d7ebd',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.990318] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: SUCCESS [ 900.990576] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.063924] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.064700] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.064700] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.064700] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.064830] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.065646] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.065646] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.065646] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.065870] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.065870] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.066026] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d933f6d4-22a1-406c-b3f4-f69901535e42 is going to be deleted. [ 901.067643] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5ccee96a-c1fb-475b-86c3-7d4f1ccff166',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.097097] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.097097] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.097097] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.097345] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.097345] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.097960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d933f6d4-22a1-406c-b3f4-f69901535e42" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.097960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d933f6d4-22a1-406c-b3f4-f69901535e42" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.097960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d933f6d4-22a1-406c-b3f4-f69901535e42" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.098154] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.098154] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.098244] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.098552] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.098552] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.098552] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d933f6d4-22a1-406c-b3f4-f69901535e42',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.110403] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.110403] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.110403] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.110403] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.110403] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.110403] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86efc288-b26f-4298-9444-58202b5c40d5 is going to be updated. [ 901.153634] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.153634] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.153634] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.153855] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.153888] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.170292] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: IN_PROGRESS for 2s [ 901.273228] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b16501ca-f12e-452b-84e5-e293f53d7ebd [ 901.273228] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.273228] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.273228] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.273228] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.273228] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.273228] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b16501ca-f12e-452b-84e5-e293f53d7ebd already deleted. [ 901.275148] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b16501ca-f12e-452b-84e5-e293f53d7ebd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.429501] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: SUCCESS [ 901.429736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.429905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.430143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.430345] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.430469] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.431590] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.431590] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.431590] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.431590] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.431590] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.571222] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5ccee96a-c1fb-475b-86c3-7d4f1ccff166',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.604501] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.604652] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.604722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.604940] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.605040] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.605264] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.605363] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.605425] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.605589] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.605663] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.605749] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d933f6d4-22a1-406c-b3f4-f69901535e42 already deleted. [ 901.605827] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d933f6d4-22a1-406c-b3f4-f69901535e42" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.605928] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d933f6d4-22a1-406c-b3f4-f69901535e42',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.606910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d933f6d4-22a1-406c-b3f4-f69901535e42" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.607184] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d933f6d4-22a1-406c-b3f4-f69901535e42" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.607184] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.607983] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.611024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.611024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.611024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.611024] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d933f6d4-22a1-406c-b3f4-f69901535e42',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.938121] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.938303] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.938387] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.938843] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.938843] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.938993] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.939070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.939245] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.939338] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.939429] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.939586] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.939682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.939771] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.939875] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.940051] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.940152] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.940210] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.940313] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.940386] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.940468] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.940562] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.074740] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.074925] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.075078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.075301] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.075375] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.075528] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 is going to be updated. [ 902.101305] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.101514] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.101514] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.104101] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.104101] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.110147] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.110340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.110410] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.110614] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.110753] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.111012] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.111127] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.111243] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.111432] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.111516] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.111608] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d933f6d4-22a1-406c-b3f4-f69901535e42 already deleted. [ 902.111692] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d933f6d4-22a1-406c-b3f4-f69901535e42" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.111957] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d933f6d4-22a1-406c-b3f4-f69901535e42',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.114904] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 in Status: IN_PROGRESS for 2s [ 902.445205] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c2da01b-6452-4ea7-a1ca-fac9de38da7b: rpc.has_security_group_logging(os_id): False [ 902.465838] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.466966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.466966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.466966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.466966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.466966] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.466966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.466966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.467302] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.467302] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.467419] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.467539] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.467624] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.467794] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.467884] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.470700] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.470700] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.470700] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.470700] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.470700] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.470700] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b is going to be updated. [ 902.527709] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.527709] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.527709] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.527709] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.529073] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.537669] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: IN_PROGRESS for 2s [ 902.616325] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d933f6d4-22a1-406c-b3f4-f69901535e42: rpc.has_security_group_logging(os_id): False [ 902.635736] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.635736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.635736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.635736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.635736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.635736] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.635736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.635736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.635736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.635736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.635736] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d933f6d4-22a1-406c-b3f4-f69901535e42 is going to be created. [ 902.657930] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/d933f6d4-22a1-406c-b3f4-f69901535e42], does not exist path=[/infra/domains/default/groups/d933f6d4-22a1-406c-b3f4-f69901535e42]."\n}' [ 902.658218] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d933f6d4-22a1-406c-b3f4-f69901535e42 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d933f6d4-22a1-406c-b3f4-f69901535e42 [ 902.658320] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 902.694325] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.694501] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.694543] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.694770] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.696176] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.696176] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.696176] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.696176] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.696385] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.696385] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.696549] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.696652] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.696715] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.696867] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.696944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.697497] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d933f6d4-22a1-406c-b3f4-f69901535e42 is going to be created. [ 902.714407] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/d933f6d4-22a1-406c-b3f4-f69901535e42], does not exist path=[/infra/domains/default/groups/d933f6d4-22a1-406c-b3f4-f69901535e42]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d933f6d4-22a1-406c-b3f4-f69901535e42 [ 902.714570] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d933f6d4-22a1-406c-b3f4-f69901535e42" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.714789] env[70013]: Traceback (most recent call last): [ 902.714844] env[70013]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 902.714844] env[70013]: return func(*args, **kwargs) [ 902.714844] env[70013]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 902.714844] env[70013]: res.raise_for_status() [ 902.714844] env[70013]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 902.714844] env[70013]: raise HTTPError(http_error_msg, response=self) [ 902.714844] env[70013]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d933f6d4-22a1-406c-b3f4-f69901535e42 [ 902.714844] env[70013]: During handling of the above exception, another exception occurred: [ 902.714844] env[70013]: Traceback (most recent call last): [ 902.714844] env[70013]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 902.714844] env[70013]: listener.cb(fileno) [ 902.714844] env[70013]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 902.714844] env[70013]: result = function(*args, **kwargs) [ 902.714844] env[70013]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 902.714844] env[70013]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 902.714844] env[70013]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 902.714844] env[70013]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 902.714844] env[70013]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 902.714844] env[70013]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 902.714844] env[70013]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 902.714844] env[70013]: res.raise_for_status() [ 902.714844] env[70013]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 902.714844] env[70013]: raise HTTPError(http_error_msg, response=self) [ 902.714844] env[70013]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d933f6d4-22a1-406c-b3f4-f69901535e42 [ 902.714844] env[70013]: Removing descriptor: 67 [ 903.024115] env[70013]: INFO networking_nsxv3.common.synchronization [None req-e74d5aa7-2b63-4fbf-af9e-938071971a08 None None] Enqueued Resource ID: ec8d50ec-23b0-4935-927b-7e39983b344b with Priority: HIGHEST for action port [ 903.024736] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec8d50ec-23b0-4935-927b-7e39983b344b with Priority: HIGHEST for action port [ 903.025600] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec8d50ec-23b0-4935-927b-7e39983b344b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.025769] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec8d50ec-23b0-4935-927b-7e39983b344b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.025842] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec8d50ec-23b0-4935-927b-7e39983b344b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.026601] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec8d50ec-23b0-4935-927b-7e39983b344b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.026601] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec8d50ec-23b0-4935-927b-7e39983b344b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.177651] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: SUCCESS [ 903.178679] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.178679] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.178679] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.178679] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.178679] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.178679] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.179034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.179034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.179034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.179306] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.179306] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.179407] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.179525] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.179611] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.180609] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.180609] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.180609] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.180609] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.180609] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.180609] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.531252] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec8d50ec-23b0-4935-927b-7e39983b344b [ 903.531252] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.531252] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.531252] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.531252] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.531252] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.531252] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec8d50ec-23b0-4935-927b-7e39983b344b already deleted. [ 903.531252] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec8d50ec-23b0-4935-927b-7e39983b344b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.682100] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 86efc288-b26f-4298-9444-58202b5c40d5: rpc.has_security_group_logging(os_id): False [ 903.701418] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.702754] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.702957] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.703383] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.732239] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.733193] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.733193] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.733193] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.733193] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.734427] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.734674] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.734787] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.734852] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.735054] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.735137] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.735335] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.735433] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.735494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.735648] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.735722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.735806] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86efc288-b26f-4298-9444-58202b5c40d5 is going to be updated. [ 903.796956] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.796956] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.796956] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.796956] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.796956] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.813961] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: IN_PROGRESS for 2s [ 904.129409] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 in Status: IN_PROGRESS for 4s [ 904.550143] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: SUCCESS [ 904.550436] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.828799] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: SUCCESS [ 905.829189] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.829189] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.829445] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.829544] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.139408] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 in Status: SUCCESS [ 906.139810] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.139901] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.140173] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.140395] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.140511] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.140576] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.140775] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.140885] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.141090] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.141205] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5ccee96a-c1fb-475b-86c3-7d4f1ccff166',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.142341] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.142555] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.142738] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.142846] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.142986] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.143187] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.143272] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.143363] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ccee96a-c1fb-475b-86c3-7d4f1ccff166',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.331945] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.332135] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.332203] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.332422] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.332588] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.332687] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.332752] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.332953] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.333102] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.333247] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.333372] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.645351] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.645505] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.649975] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5ccee96a-c1fb-475b-86c3-7d4f1ccff166',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.835827] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.836146] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.836146] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.836508] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.836612] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.836771] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.836872] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.837076] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.837176] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.837380] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.837445] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.837502] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.837580] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.837733] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.837885] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.837954] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.838014] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.838154] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.838233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.838317] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.838400] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.153079] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5ccee96a-c1fb-475b-86c3-7d4f1ccff166',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.158281] env[70013]: INFO networking_nsxv3.common.synchronization [req-7b0ce31a-b84b-4f93-8233-a2279c30bdf5 req-709271d5-5f39-4d22-8e6c-1c75e988bea7 tempest-ServerRescueTestJSONUnderV235-1838383190 tempest-ServerRescueTestJSONUnderV235-1838383190-project-member] Enqueued Resource ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 with Priority: HIGHEST for action security_group_members [ 907.158817] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 with Priority: HIGHEST for action security_group_members [ 907.159174] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.159271] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.340519] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 86efc288-b26f-4298-9444-58202b5c40d5: rpc.has_security_group_logging(os_id): False [ 907.369606] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.369794] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.369905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.370225] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.370367] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.370643] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.370790] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.370892] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.371099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.371199] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.371388] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.371484] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.371546] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.371689] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.371764] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.371945] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.372181] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.372418] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.372418] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.372534] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.372534] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86efc288-b26f-4298-9444-58202b5c40d5 is going to be updated. [ 907.385613] env[70013]: INFO networking_nsxv3.common.synchronization [req-203e4e8e-5e02-4219-96b6-0d1e0dd3b67b req-ef17f088-2de8-4608-9fc0-462e99b3a1d1 tempest-MultipleCreateTestJSON-634477930 tempest-MultipleCreateTestJSON-634477930-project-member] Enqueued Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_members [ 907.386175] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_members [ 907.386488] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.386603] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.386669] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.386856] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.387016] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.387929] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.388036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.388188] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.388267] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.388365] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.434990] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.434990] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.434990] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.434990] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.435583] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.450521] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: IN_PROGRESS for 2s [ 907.655251] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.655251] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.655414] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.655564] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.655659] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.655762] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 is going to be updated. [ 907.683946] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.684141] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.684262] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.684396] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.684544] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.702656] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 in Status: IN_PROGRESS for 2s [ 907.890359] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.183755] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-269 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.185027] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-269" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.185027] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-269" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.185027] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-269" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.185027] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.185469] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.185469] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.185681] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.185831] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.186142] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 908.186288] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 908.186410] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 908.186535] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 908.186653] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 908.186765] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 908.186908] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 908.210998] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 908.211413] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 908.211604] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 908.211804] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-269" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.212142] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-4896df9a-0702-4071-8432-b95ec01f1d13 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.212346] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-4896df9a-0702-4071-8432-b95ec01f1d13" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.212509] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-4896df9a-0702-4071-8432-b95ec01f1d13" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.213060] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-4896df9a-0702-4071-8432-b95ec01f1d13" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.213285] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4896df9a-0702-4071-8432-b95ec01f1d13',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.393078] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.718246] env[70013]: INFO networking_nsxv3.common.synchronization [req-be6f6e60-270c-4235-834e-ddbca95a8ef0 req-5776620e-9f53-4c49-8646-85de433a3842 tempest-ServersTestMultiNic-1935476789 tempest-ServersTestMultiNic-1935476789-project-member] Enqueued Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 908.719009] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.719377] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.719573] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.719952] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.720172] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.720436] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 4896df9a-0702-4071-8432-b95ec01f1d13 not found, creating... [ 908.720830] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.721137] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.721335] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.721692] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.721931] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.722553] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.722809] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.723071] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.723384] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.723621] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.723803] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 4896df9a-0702-4071-8432-b95ec01f1d13 is going to be created. [ 908.725828] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 908.726306] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.726503] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.726627] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.728763] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.729069] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.729644] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.729835] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.730095] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.730218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.731427] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.755876] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.755876] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.755876] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.755876] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.755876] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.755876] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-4896df9a-0702-4071-8432-b95ec01f1d13" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.896901] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.897311] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.897311] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.897386] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.898061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.898061] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b is going to be updated. [ 908.928691] env[70013]: INFO networking_nsxv3.common.synchronization [req-be6f6e60-270c-4235-834e-ddbca95a8ef0 req-765004c9-3fb1-4d7a-878f-c70a223ff9e2 tempest-ServersTestMultiNic-1935476789 tempest-ServersTestMultiNic-1935476789-project-member] Enqueued Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 908.929790] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.929937] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.929995] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.930390] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.930544] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.931829] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGHEST for action security_group_members [ 908.932147] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.932250] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.943955] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: IN_PROGRESS for 2s [ 909.237535] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.473229] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: SUCCESS [ 909.473450] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.565171] env[70013]: INFO networking_nsxv3.common.synchronization [req-203e4e8e-5e02-4219-96b6-0d1e0dd3b67b req-19f19186-d2dc-4515-bd43-a3be74ae476c service nova] Enqueued Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_rules [ 909.565351] env[70013]: INFO networking_nsxv3.common.synchronization [req-203e4e8e-5e02-4219-96b6-0d1e0dd3b67b req-19f19186-d2dc-4515-bd43-a3be74ae476c service nova] Enqueued Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_members [ 909.565492] env[70013]: INFO networking_nsxv3.common.synchronization [req-203e4e8e-5e02-4219-96b6-0d1e0dd3b67b req-19f19186-d2dc-4515-bd43-a3be74ae476c service nova] Enqueued Resource ID: 4896df9a-0702-4071-8432-b95ec01f1d13 with Priority: HIGHEST for action port [ 909.566022] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_rules [ 909.566148] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_members [ 909.566240] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4896df9a-0702-4071-8432-b95ec01f1d13 with Priority: HIGHEST for action port [ 909.566516] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.566622] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.566724] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.566889] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.566964] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.567814] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.567915] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.568333] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-4896df9a-0702-4071-8432-b95ec01f1d13 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.568333] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4896df9a-0702-4071-8432-b95ec01f1d13" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.568333] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4896df9a-0702-4071-8432-b95ec01f1d13" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.568547] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4896df9a-0702-4071-8432-b95ec01f1d13" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.568547] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4896df9a-0702-4071-8432-b95ec01f1d13',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.717689] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 in Status: SUCCESS [ 909.717909] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.718065] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.718298] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.718489] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.718608] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.718675] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.718822] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.718907] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.719021] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ccee96a-c1fb-475b-86c3-7d4f1ccff166',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.745283] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.070289] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.070612] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.070653] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4896df9a-0702-4071-8432-b95ec01f1d13 with status ACTIVE [ 910.070828] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.071082] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.071082] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.071258] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.071363] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.071536] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.071643] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.071705] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.071892] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.071934] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.072136] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.072242] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.072309] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.072450] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.072537] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.072622] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4896df9a-0702-4071-8432-b95ec01f1d13 is going to be updated. [ 910.092794] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.092963] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.093123] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.093291] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.093426] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.093598] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4896df9a-0702-4071-8432-b95ec01f1d13" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.190103] env[70013]: INFO networking_nsxv3.common.synchronization [req-73670647-5313-4081-bfa7-4e08399dad5a req-f776d8ac-5882-4b16-9394-458cdc0133dd tempest-ImagesTestJSON-851757871 tempest-ImagesTestJSON-851757871-project-member] Enqueued Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 910.190625] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 910.190974] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.191554] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.191633] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.191854] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.191990] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.192118] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.192223] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.192431] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.192527] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.192625] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.221320] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.221563] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.221644] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.221856] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.245895] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.246185] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.246308] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.246380] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.246571] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.246656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.246751] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 is going to be updated. [ 910.247946] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.248096] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.248165] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.248304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.248383] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.248488] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86efc288-b26f-4298-9444-58202b5c40d5 is going to be updated. [ 910.275567] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.275725] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.275796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.276021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.276186] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.278010] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.278170] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.278236] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.278415] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.278538] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.290462] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: IN_PROGRESS for 2s [ 910.291165] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 in Status: IN_PROGRESS for 2s [ 910.697237] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.707903] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-875 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.708345] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-875" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.708675] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-875" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.708993] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-875" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.709543] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.709939] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.710187] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.710454] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.710610] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.710926] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 910.710926] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 910.711063] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 910.711175] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 910.711302] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 910.711485] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 910.711651] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 910.734591] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 910.734591] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 910.734591] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 910.734591] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-875" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.735169] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-5b0a839b-040e-424a-b8ad-91a46034cde9 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.735538] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-5b0a839b-040e-424a-b8ad-91a46034cde9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.735721] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-5b0a839b-040e-424a-b8ad-91a46034cde9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.736196] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-5b0a839b-040e-424a-b8ad-91a46034cde9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.736482] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b0a839b-040e-424a-b8ad-91a46034cde9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.949821] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: SUCCESS [ 910.949821] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.949821] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.949821] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.949821] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.950135] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.950135] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.950135] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.950236] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.950281] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.199513] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.240187] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.240401] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.240710] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.240812] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.240977] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.241175] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 5b0a839b-040e-424a-b8ad-91a46034cde9 not found, creating... [ 911.241437] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.241599] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.241719] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.241936] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.242117] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.242415] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.242566] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.242683] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.242895] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.243073] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.243253] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 5b0a839b-040e-424a-b8ad-91a46034cde9 is going to be created. [ 911.265384] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.265590] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.265718] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.265974] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.266260] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.266486] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-5b0a839b-040e-424a-b8ad-91a46034cde9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.452176] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.703557] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.703557] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.704354] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.704354] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.704354] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.704354] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 is going to be updated. [ 911.730845] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.731048] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.731129] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.731349] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.731502] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.740095] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: IN_PROGRESS for 2s [ 911.954977] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.092025] env[70013]: INFO networking_nsxv3.common.synchronization [req-73670647-5313-4081-bfa7-4e08399dad5a req-74ee3fa3-c889-4318-8cd0-481bb0af98dd service nova] Enqueued Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_rules [ 912.092025] env[70013]: INFO networking_nsxv3.common.synchronization [req-73670647-5313-4081-bfa7-4e08399dad5a req-74ee3fa3-c889-4318-8cd0-481bb0af98dd service nova] Enqueued Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 912.092025] env[70013]: INFO networking_nsxv3.common.synchronization [req-73670647-5313-4081-bfa7-4e08399dad5a req-74ee3fa3-c889-4318-8cd0-481bb0af98dd service nova] Enqueued Resource ID: 5b0a839b-040e-424a-b8ad-91a46034cde9 with Priority: HIGHEST for action port [ 912.092025] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_rules [ 912.092025] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 912.092025] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b0a839b-040e-424a-b8ad-91a46034cde9 with Priority: HIGHEST for action port [ 912.093014] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.093381] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.093523] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.093873] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.096907] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.096907] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.096907] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.096907] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b0a839b-040e-424a-b8ad-91a46034cde9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.096907] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b0a839b-040e-424a-b8ad-91a46034cde9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.096907] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b0a839b-040e-424a-b8ad-91a46034cde9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.096907] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b0a839b-040e-424a-b8ad-91a46034cde9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.096907] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b0a839b-040e-424a-b8ad-91a46034cde9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.304019] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: SUCCESS [ 912.304019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.304019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.304019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.304019] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.304019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.304019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.304019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.304019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.304019] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.304019] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 in Status: SUCCESS [ 912.304019] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 deletion is rescheduled due to dependency. [ 912.304660] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.304916] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.305193] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.305665] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.305882] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.306046] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.306416] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.306602] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.306774] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.307095] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.307427] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.307577] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.307804] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.308069] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.308280] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.308415] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.308723] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.308874] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.309045] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.309208] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5ccee96a-c1fb-475b-86c3-7d4f1ccff166',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.310252] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.310512] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.310768] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.310993] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.311169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.311393] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.311573] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.311756] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ccee96a-c1fb-475b-86c3-7d4f1ccff166',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.457864] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.458046] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.458046] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.458272] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.458416] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.458561] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b is going to be updated. [ 912.490030] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.490030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.490030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.490242] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.490364] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.501948] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: IN_PROGRESS for 2s [ 912.599116] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.599265] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.599623] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b0a839b-040e-424a-b8ad-91a46034cde9 with status ACTIVE [ 912.599815] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.599955] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.600044] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.600268] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.600361] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.600532] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.600627] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.600688] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.600839] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.600924] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.601148] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.601245] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.601308] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.601455] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.601531] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.601616] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b0a839b-040e-424a-b8ad-91a46034cde9 is going to be updated. [ 912.631508] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.631508] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.631660] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.633061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.633061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.633061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b0a839b-040e-424a-b8ad-91a46034cde9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.811489] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.811735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.811854] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.812145] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.812298] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.812592] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.812727] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.812840] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.813084] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.813276] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.816711] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86efc288-b26f-4298-9444-58202b5c40d5 is going to be updated. [ 912.816711] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5ccee96a-c1fb-475b-86c3-7d4f1ccff166: rpc.has_security_group_logging(os_id): False [ 912.817959] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.817959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.817959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.817959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.817959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.817959] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.817959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.817959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.817959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.817959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.817959] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 is going to be updated. [ 912.830913] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.831160] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.831196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.831431] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.831537] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.832194] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.832194] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.832194] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.832392] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.832392] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.832637] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.832767] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.832833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.833040] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.833130] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.833335] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.834464] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.834464] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.834464] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.834464] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.834464] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 is going to be updated. [ 912.841931] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.841931] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.841931] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.842280] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.842280] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.844410] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.844542] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.844640] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.844829] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.844933] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.854850] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: IN_PROGRESS for 2s [ 912.854850] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 in Status: IN_PROGRESS for 2s [ 912.899597] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.899597] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.899597] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.899597] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.899597] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.915070] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 in Status: IN_PROGRESS for 2s [ 913.011785] env[70013]: INFO networking_nsxv3.common.synchronization [req-02f7d238-57c7-4c6c-b16c-f336346d61a3 req-88aac701-a54f-4a65-a82f-194bf955f27f tempest-DeleteServersTestJSON-1971284771 tempest-DeleteServersTestJSON-1971284771-project-member] Enqueued Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 913.011785] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 913.011785] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.011785] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.012263] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.012637] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.013444] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.013745] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.013947] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.015371] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.015371] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.015371] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.509059] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-446 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.509406] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-446" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.509455] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-446" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.509697] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-446" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.509959] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.510171] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.510298] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.510530] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.510683] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.510899] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 913.511062] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 913.511199] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 913.511333] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 913.511512] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 913.511571] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 913.511708] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 913.517055] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.517236] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.517329] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.517536] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.517625] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.517826] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.517938] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.518019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.518189] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.518267] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.518370] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b is going to be deleted. [ 913.551284] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 913.551542] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 913.551749] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 913.551936] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-446" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.552600] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-40bf9877-260b-49fc-85fd-307072a733f1 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.552789] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-40bf9877-260b-49fc-85fd-307072a733f1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.552956] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-40bf9877-260b-49fc-85fd-307072a733f1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.553315] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-40bf9877-260b-49fc-85fd-307072a733f1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.553478] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40bf9877-260b-49fc-85fd-307072a733f1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.581959] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.581959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.581959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.581959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.581959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.581959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.686095] env[70013]: INFO networking_nsxv3.common.synchronization [req-29371888-e02a-43ba-bcf6-3641d5f1ceac req-14908d75-6019-4d4b-bc52-e8cbd54d617c tempest-ListServersNegativeTestJSON-1728183933 tempest-ListServersNegativeTestJSON-1728183933-project-member] Enqueued Resource ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 with Priority: HIGHEST for action security_group_members [ 913.687095] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 with Priority: HIGHEST for action security_group_members [ 913.687430] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.687559] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.687668] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.687902] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.688077] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.688181] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.688251] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.688407] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.688496] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.688602] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.751700] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: SUCCESS [ 913.754022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.754022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.754022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.754022] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.754022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.754022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.754022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.754022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.754022] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.056443] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.057064] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.057495] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.058009] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.058390] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.062225] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 40bf9877-260b-49fc-85fd-307072a733f1 not found, creating... [ 914.062225] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.062225] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.062225] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.062225] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.062225] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.062225] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.062225] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.062225] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.062225] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.062802] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.064233] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 40bf9877-260b-49fc-85fd-307072a733f1 is going to be created. [ 914.067301] env[70013]: INFO networking_nsxv3.common.synchronization [req-521ffcfb-6b37-4755-abf4-a675e776b827 req-0a8f5711-62f9-48d3-8183-8db047f88ec8 tempest-ListServersNegativeTestJSON-1728183933 tempest-ListServersNegativeTestJSON-1728183933-project-member] Enqueued Resource ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 with Priority: HIGHEST for action security_group_members [ 914.069102] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 with Priority: HIGHEST for action security_group_members [ 914.069738] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.071187] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.095212] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.095551] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.095698] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.095967] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.096229] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.096453] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-40bf9877-260b-49fc-85fd-307072a733f1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.191097] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.259325] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.511514] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: SUCCESS [ 914.511839] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.511959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.512537] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.512537] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.512537] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.512712] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.512759] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.512794] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.512880] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.512974] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.695269] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.761191] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.869264] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 in Status: SUCCESS [ 914.869264] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 deletion is rescheduled due to dependency. [ 914.869264] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.869264] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 86efc288-b26f-4298-9444-58202b5c40d5 in Status: SUCCESS [ 914.869264] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 86efc288-b26f-4298-9444-58202b5c40d5 deletion is rescheduled due to dependency. [ 914.869264] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.928456] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 in Status: SUCCESS [ 914.928456] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.928456] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.928456] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.928456] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ccee96a-c1fb-475b-86c3-7d4f1ccff166',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.018856] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.018856] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.018856] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.018856] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.018856] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.018856] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.018856] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.018856] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.018856] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.018856] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.018856] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.018856] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.018856] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.018856] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.018856] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.018856] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.019595] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.019595] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.019595] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.019595] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.019595] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.200643] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.200643] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.200643] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.200927] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.200977] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.201079] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 is going to be updated. [ 915.225121] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.225278] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.225366] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.225596] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.225740] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.239061] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 in Status: IN_PROGRESS for 2s [ 915.268023] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.268023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.268023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.268023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.268023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.268023] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 is going to be updated. [ 915.294213] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.294850] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.294850] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.294850] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.294850] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.302038] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: IN_PROGRESS for 2s [ 915.452758] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.452979] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.452979] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.453242] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.453346] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.453447] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ccee96a-c1fb-475b-86c3-7d4f1ccff166 is going to be deleted. [ 915.463814] env[70013]: INFO networking_nsxv3.common.synchronization [req-02f7d238-57c7-4c6c-b16c-f336346d61a3 req-931a2f40-0e0b-4c9c-8e17-dc36448b038b service nova] Enqueued Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_rules [ 915.464016] env[70013]: INFO networking_nsxv3.common.synchronization [req-02f7d238-57c7-4c6c-b16c-f336346d61a3 req-931a2f40-0e0b-4c9c-8e17-dc36448b038b service nova] Enqueued Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 915.464169] env[70013]: INFO networking_nsxv3.common.synchronization [req-02f7d238-57c7-4c6c-b16c-f336346d61a3 req-931a2f40-0e0b-4c9c-8e17-dc36448b038b service nova] Enqueued Resource ID: 40bf9877-260b-49fc-85fd-307072a733f1 with Priority: HIGHEST for action port [ 915.464403] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_rules [ 915.464532] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 915.464629] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40bf9877-260b-49fc-85fd-307072a733f1 with Priority: HIGHEST for action port [ 915.465160] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.465300] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.465391] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.465625] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.465689] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.467032] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.467163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.467163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.467359] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.467529] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.467611] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.467720] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.467821] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.467907] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.467998] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.469077] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-40bf9877-260b-49fc-85fd-307072a733f1 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.469189] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40bf9877-260b-49fc-85fd-307072a733f1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.469257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40bf9877-260b-49fc-85fd-307072a733f1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.469441] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40bf9877-260b-49fc-85fd-307072a733f1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.469515] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40bf9877-260b-49fc-85fd-307072a733f1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.500252] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.500442] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.500723] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.500990] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.501136] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.501266] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ccee96a-c1fb-475b-86c3-7d4f1ccff166" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.521700] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c2da01b-6452-4ea7-a1ca-fac9de38da7b: rpc.has_security_group_logging(os_id): False [ 915.545901] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.546647] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.546774] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.547018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.574358] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.574565] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.574692] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.574762] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.574976] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.575077] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.575288] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.575392] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.575456] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.575615] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.575692] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.575889] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.575983] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.576058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.576207] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.576295] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.576363] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b is going to be updated. [ 915.651777] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.651919] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.651996] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.652957] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.652957] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.667279] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: IN_PROGRESS for 2s [ 915.970963] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.972083] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.972210] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.972676] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40bf9877-260b-49fc-85fd-307072a733f1 with status ACTIVE [ 915.972977] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.972977] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.973129] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.973780] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.973780] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.973780] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.973780] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.974032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.974182] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.974275] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.974670] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.975333] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.975333] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.977257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.977257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.977257] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40bf9877-260b-49fc-85fd-307072a733f1 is going to be updated. [ 915.996379] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.996527] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.996643] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.997015] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.997239] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.997475] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40bf9877-260b-49fc-85fd-307072a733f1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.131229] env[70013]: INFO networking_nsxv3.common.synchronization [req-86fe144a-f6e0-4d5b-90e7-9c1a169db90c req-07d58c90-955c-4c82-8e6c-cc7f347fdceb tempest-ServersAdminTestJSON-1183835690 tempest-ServersAdminTestJSON-1183835690-project-member] Enqueued Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_members [ 916.131734] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_members [ 916.132060] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7abade-e912-4196-b558-4a6d4ece9b29 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.132188] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.132251] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.132500] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.132673] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.132800] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.132866] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.133057] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.133153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.133261] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.473554] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.636801] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.976769] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.976944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.977032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.977248] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.977340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.977441] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b is going to be created. [ 917.002254] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.002254] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.002254] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.002254] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.002564] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.018155] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: UNINITIALIZED for 2s [ 917.054609] env[70013]: INFO networking_nsxv3.common.synchronization [req-e3dad012-c5e9-4ef0-9640-3ca021447407 req-4d0b95a9-2815-494d-815f-6d97fcf944d0 tempest-ListServerFiltersTestJSON-1686378133 tempest-ListServerFiltersTestJSON-1686378133-project-member] Enqueued Resource ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 with Priority: HIGHEST for action security_group_members [ 917.054609] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 with Priority: HIGHEST for action security_group_members [ 917.054609] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb27dbe1-6f26-411f-bcfc-69daca38eb24 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.054609] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.054609] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.054609] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.054609] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.054609] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.054609] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.054609] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.054609] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.054609] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.139086] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.252633] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 in Status: SUCCESS [ 917.252633] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.252633] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.252633] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.252938] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.252938] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.252938] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.253202] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.253280] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.253379] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.311966] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: SUCCESS [ 917.312218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.312449] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.312720] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.312972] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.313153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.313211] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.313364] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.313725] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.313725] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.313725] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.558846] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.559313] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.559481] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.559784] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.560381] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.560733] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.561604] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.561604] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.561604] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.561604] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.561604] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 already deleted. [ 917.561604] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.641258] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.641258] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-438" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.641258] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-438" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.641258] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-438" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.641258] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.642259] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.642583] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.643068] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.643572] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.644962] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 917.644962] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 917.644962] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 917.644962] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 917.644962] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 917.644962] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 917.645518] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 917.648066] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.648971] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.648971] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.648971] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.648971] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.648971] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 is going to be updated. [ 917.666602] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 917.666829] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 917.667144] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 917.667352] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-438" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.667742] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-7648a826-e268-4333-96ce-f336ff254b66 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.668117] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-7648a826-e268-4333-96ce-f336ff254b66" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.668198] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-7648a826-e268-4333-96ce-f336ff254b66" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.668505] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-7648a826-e268-4333-96ce-f336ff254b66" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.668658] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7648a826-e268-4333-96ce-f336ff254b66',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.677536] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.677696] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.677733] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.677949] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.678109] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.682699] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: SUCCESS [ 917.682872] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.685393] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: IN_PROGRESS for 2s [ 917.757353] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.757613] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.757738] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.757910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.782171] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.782387] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.782582] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.782678] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.782962] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.783241] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.783391] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 is going to be updated. [ 917.807784] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.807939] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.808118] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.808334] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.808481] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.817089] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 in Status: IN_PROGRESS for 2s [ 917.817436] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.817586] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.817688] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.817953] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.818173] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.818338] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.818439] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.818628] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.818723] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.818819] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.819049] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.819182] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.819265] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.819421] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.819580] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.819721] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.819779] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.819941] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.820050] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.820169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.820288] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.172676] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.173104] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.173225] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.173704] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.173822] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.174016] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 7648a826-e268-4333-96ce-f336ff254b66 not found, creating... [ 918.174497] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.174802] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.174902] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.177292] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.177491] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.177877] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.178118] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.178475] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.178684] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.178962] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.179157] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 7648a826-e268-4333-96ce-f336ff254b66 is going to be created. [ 918.200409] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.200648] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.200861] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.201243] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.201388] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.201631] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-7648a826-e268-4333-96ce-f336ff254b66" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.325248] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc1b714b-7da7-41dc-b21f-d8ad167c33d9: rpc.has_security_group_logging(os_id): False [ 918.355081] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.355246] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.355425] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.355574] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.388161] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.388545] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.388690] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.388770] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.388951] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.389044] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.389236] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.389355] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.389417] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.389904] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.389904] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.389904] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.390244] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.390244] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.390362] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.390485] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.390485] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 is going to be updated. [ 918.455020] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.455020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.455020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.455020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.455020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.463363] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: IN_PROGRESS for 2s [ 919.028036] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: SUCCESS [ 919.028036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.028036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.028036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.028036] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.028636] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.028636] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.028636] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.028636] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.028636] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.028636] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.537359] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.537561] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.537621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.537847] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.538047] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.538161] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.538233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.538396] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.538486] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.538576] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.538743] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.538838] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.538901] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.539061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.539204] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.539298] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.542888] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.543921] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.544106] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.544245] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.544327] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.673751] env[70013]: INFO networking_nsxv3.common.synchronization [req-8c94a7e6-d7d3-491f-bb90-60dd74dc03af req-371cf192-b6ba-4d2b-8d8e-ee3942651358 tempest-ListServerFiltersTestJSON-1686378133 tempest-ListServerFiltersTestJSON-1686378133-project-member] Enqueued Resource ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 with Priority: HIGHEST for action security_group_members [ 919.673751] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 with Priority: HIGHEST for action security_group_members [ 919.673751] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb27dbe1-6f26-411f-bcfc-69daca38eb24 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.673751] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.673751] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.676893] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.680523] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.680523] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.680523] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.680523] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.680523] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.680523] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.689371] env[70013]: INFO networking_nsxv3.common.synchronization [req-e3dad012-c5e9-4ef0-9640-3ca021447407 req-c778fb59-5637-4b72-87f8-258756a00e25 service nova] Enqueued Resource ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 with Priority: HIGHEST for action security_group_rules [ 919.689564] env[70013]: INFO networking_nsxv3.common.synchronization [req-e3dad012-c5e9-4ef0-9640-3ca021447407 req-c778fb59-5637-4b72-87f8-258756a00e25 service nova] Enqueued Resource ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 with Priority: HIGHEST for action security_group_members [ 919.689727] env[70013]: INFO networking_nsxv3.common.synchronization [req-e3dad012-c5e9-4ef0-9640-3ca021447407 req-c778fb59-5637-4b72-87f8-258756a00e25 service nova] Enqueued Resource ID: 7648a826-e268-4333-96ce-f336ff254b66 with Priority: HIGHEST for action port [ 919.689980] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 with Priority: HIGHEST for action security_group_rules [ 919.690124] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 with Priority: HIGHEST for action security_group_members [ 919.690240] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7648a826-e268-4333-96ce-f336ff254b66 with Priority: HIGHEST for action port [ 919.690873] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb27dbe1-6f26-411f-bcfc-69daca38eb24 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.691385] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.691659] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.691944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.692067] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.693232] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb27dbe1-6f26-411f-bcfc-69daca38eb24 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.693366] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.693598] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-7648a826-e268-4333-96ce-f336ff254b66 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.693704] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7648a826-e268-4333-96ce-f336ff254b66" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.693839] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7648a826-e268-4333-96ce-f336ff254b66" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.694025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7648a826-e268-4333-96ce-f336ff254b66" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.694185] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7648a826-e268-4333-96ce-f336ff254b66',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.697117] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: SUCCESS [ 919.697372] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.825937] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 in Status: SUCCESS [ 919.826149] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 deletion is rescheduled due to dependency. [ 919.826268] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.053523] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16c877e7-f731-49a5-b994-7d74c36c464b: rpc.has_security_group_logging(os_id): False [ 920.069995] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.070180] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.070256] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.070472] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.070563] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.070778] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.070879] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.070945] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.071160] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.071306] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.071516] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.071610] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.071670] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.071818] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.071896] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.075178] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.075307] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.075379] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.075556] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.075841] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.075841] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b is going to be created. [ 920.127260] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.127413] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.127483] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.127712] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.127905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.138661] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: IN_PROGRESS for 2s [ 920.189365] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.197158] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb27dbe1-6f26-411f-bcfc-69daca38eb24 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.197299] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.197870] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7648a826-e268-4333-96ce-f336ff254b66 with status ACTIVE [ 920.198155] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.198464] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.198635] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.198869] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.198968] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.199238] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.199311] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.199377] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.199476] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.199557] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.199831] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.199945] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.201389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.201609] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.201697] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.201839] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7648a826-e268-4333-96ce-f336ff254b66 is going to be updated. [ 920.240699] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.240699] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.240842] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.240928] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.241137] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.241268] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7648a826-e268-4333-96ce-f336ff254b66" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.351205] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.352582] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-438" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.352762] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-438" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.353099] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-438" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.353397] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.353604] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.353749] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.353994] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.354239] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.354412] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 920.354538] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 920.354654] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 920.354769] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 920.354883] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 920.354995] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 920.355164] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 920.381318] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 920.381506] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 920.381649] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 920.381852] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-438" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.382282] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-3a364f68-e0c0-48ae-ab70-f576cd06610e taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.382480] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-3a364f68-e0c0-48ae-ab70-f576cd06610e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.382607] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-3a364f68-e0c0-48ae-ab70-f576cd06610e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.382930] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-3a364f68-e0c0-48ae-ab70-f576cd06610e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.383125] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a364f68-e0c0-48ae-ab70-f576cd06610e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.477570] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: SUCCESS [ 920.477570] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.695069] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.888031] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.888031] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.888031] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.888031] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.888031] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.888031] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 3a364f68-e0c0-48ae-ab70-f576cd06610e not found, creating... [ 920.888031] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.888031] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.888031] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.888031] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.888031] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.889507] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.889978] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.890293] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.890693] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.892047] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.892047] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 3a364f68-e0c0-48ae-ab70-f576cd06610e is going to be created. [ 920.911118] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.912323] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.913519] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.913519] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.913519] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.914030] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-3a364f68-e0c0-48ae-ab70-f576cd06610e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.197220] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.197582] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.197582] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.197676] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.197758] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.197859] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 is going to be created. [ 921.226656] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.227126] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.227331] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.227596] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.227810] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.242059] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 in Status: UNINITIALIZED for 2s [ 921.667549] env[70013]: INFO networking_nsxv3.common.synchronization [req-8c94a7e6-d7d3-491f-bb90-60dd74dc03af req-b6f81abb-d9bf-40df-ba1e-b2450d25a845 service nova] Enqueued Resource ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 with Priority: HIGHEST for action security_group_rules [ 921.667727] env[70013]: INFO networking_nsxv3.common.synchronization [req-8c94a7e6-d7d3-491f-bb90-60dd74dc03af req-b6f81abb-d9bf-40df-ba1e-b2450d25a845 service nova] Enqueued Resource ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 with Priority: HIGHEST for action security_group_members [ 921.667866] env[70013]: INFO networking_nsxv3.common.synchronization [req-8c94a7e6-d7d3-491f-bb90-60dd74dc03af req-b6f81abb-d9bf-40df-ba1e-b2450d25a845 service nova] Enqueued Resource ID: 3a364f68-e0c0-48ae-ab70-f576cd06610e with Priority: HIGHEST for action port [ 921.668128] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 with Priority: HIGHEST for action security_group_rules [ 921.668258] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 with Priority: HIGHEST for action security_group_members [ 921.668355] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a364f68-e0c0-48ae-ab70-f576cd06610e with Priority: HIGHEST for action port [ 921.672397] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb27dbe1-6f26-411f-bcfc-69daca38eb24 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.672514] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.673232] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb27dbe1-6f26-411f-bcfc-69daca38eb24 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.673343] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.673506] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a364f68-e0c0-48ae-ab70-f576cd06610e taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.673614] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a364f68-e0c0-48ae-ab70-f576cd06610e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.673693] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a364f68-e0c0-48ae-ab70-f576cd06610e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.673906] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a364f68-e0c0-48ae-ab70-f576cd06610e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.673986] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a364f68-e0c0-48ae-ab70-f576cd06610e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.732279] env[70013]: INFO networking_nsxv3.common.synchronization [None req-b448a867-87c4-4470-b916-1f39bf9182c0 None None] Enqueued Resource ID: 588fcb8b-2111-43aa-8ea9-d3c15e628ace with Priority: HIGHEST for action port [ 921.732945] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 588fcb8b-2111-43aa-8ea9-d3c15e628ace with Priority: HIGHEST for action port [ 921.735473] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-588fcb8b-2111-43aa-8ea9-d3c15e628ace taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.735585] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-588fcb8b-2111-43aa-8ea9-d3c15e628ace" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.735699] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-588fcb8b-2111-43aa-8ea9-d3c15e628ace" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.735978] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-588fcb8b-2111-43aa-8ea9-d3c15e628ace" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.736050] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('588fcb8b-2111-43aa-8ea9-d3c15e628ace',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.155336] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: SUCCESS [ 922.155577] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.180452] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a364f68-e0c0-48ae-ab70-f576cd06610e with status ACTIVE [ 922.180895] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.180895] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.181052] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.181247] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.181368] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.181572] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.181680] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.181743] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.181895] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.181973] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.182196] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.182300] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.182373] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.182518] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.182593] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.182688] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a364f68-e0c0-48ae-ab70-f576cd06610e is going to be updated. [ 922.232022] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.236039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.236039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.236039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.236039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.236039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a364f68-e0c0-48ae-ab70-f576cd06610e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.239953] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 588fcb8b-2111-43aa-8ea9-d3c15e628ace [ 922.240208] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.240347] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.240439] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.240762] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.240837] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.240939] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:588fcb8b-2111-43aa-8ea9-d3c15e628ace already deleted. [ 922.241049] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-588fcb8b-2111-43aa-8ea9-d3c15e628ace" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.410482] env[70013]: INFO networking_nsxv3.common.synchronization [req-bd5b4c1b-4f3f-4068-95a1-995f4cf0f4c1 req-caaebf60-5f2b-4bda-922f-82ad18a58f1e tempest-ListServerFiltersTestJSON-1686378133 tempest-ListServerFiltersTestJSON-1686378133-project-member] Enqueued Resource ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 with Priority: HIGHEST for action security_group_members [ 922.411389] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 with Priority: HIGHEST for action security_group_members [ 922.411766] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb27dbe1-6f26-411f-bcfc-69daca38eb24 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.411885] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.849202] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.849202] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-438" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.849202] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-438" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.849202] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-438" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.849202] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.849202] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.849202] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.849202] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.849202] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.850422] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 922.850422] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 922.850422] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 922.850953] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 922.851186] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 922.851993] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 922.851993] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 922.871468] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 922.871611] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 922.871666] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 922.871846] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-438" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.872215] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-ad1f3bb4-6fad-4f75-ad98-b53b3676f111 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.873556] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-ad1f3bb4-6fad-4f75-ad98-b53b3676f111" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.873556] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-ad1f3bb4-6fad-4f75-ad98-b53b3676f111" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.873556] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-ad1f3bb4-6fad-4f75-ad98-b53b3676f111" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.873556] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad1f3bb4-6fad-4f75-ad98-b53b3676f111',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.142134] env[70013]: INFO networking_nsxv3.common.synchronization [req-8e5e3c9a-8f68-4dc3-b34f-bbdf12f20975 req-2f5743f1-0813-4ea3-9351-df1bd4a7f92b tempest-MultipleCreateTestJSON-634477930 tempest-MultipleCreateTestJSON-634477930-project-member] Enqueued Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_members [ 923.142134] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_members [ 923.142932] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.143784] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.143784] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.143784] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.143784] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.143784] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.143784] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.144017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.144017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.144137] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.253347] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 in Status: SUCCESS [ 923.253347] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.253347] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.257070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.257070] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.257070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.257070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.257070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.257070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.257070] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.380335] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.380335] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.380335] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.380335] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.380335] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.380335] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port ad1f3bb4-6fad-4f75-ad98-b53b3676f111 not found, creating... [ 923.380335] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.380335] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.380335] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.380335] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.380335] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.380747] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.380747] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.380747] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.380747] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.380908] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.381270] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: ad1f3bb4-6fad-4f75-ad98-b53b3676f111 is going to be created. [ 923.404045] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.404359] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.404559] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.404955] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.405365] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.405703] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-ad1f3bb4-6fad-4f75-ad98-b53b3676f111" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.646440] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.761777] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.875215] env[70013]: INFO networking_nsxv3.common.synchronization [None req-c1daebfc-c17a-452a-ba0e-9ede65a32598 None None] Enqueued Resource ID: cacdb940-f750-4543-85f6-4b3fda0b646e with Priority: HIGHEST for action port [ 923.875215] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacdb940-f750-4543-85f6-4b3fda0b646e with Priority: HIGHEST for action port [ 923.875215] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-cacdb940-f750-4543-85f6-4b3fda0b646e taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.875215] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cacdb940-f750-4543-85f6-4b3fda0b646e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.875215] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cacdb940-f750-4543-85f6-4b3fda0b646e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.875762] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cacdb940-f750-4543-85f6-4b3fda0b646e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.875913] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cacdb940-f750-4543-85f6-4b3fda0b646e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.148728] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.180514] env[70013]: INFO networking_nsxv3.common.synchronization [req-bd5b4c1b-4f3f-4068-95a1-995f4cf0f4c1 req-4c268963-5080-426f-862a-fc5f22db6bd6 service nova] Enqueued Resource ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 with Priority: HIGHEST for action security_group_rules [ 924.180514] env[70013]: INFO networking_nsxv3.common.synchronization [req-bd5b4c1b-4f3f-4068-95a1-995f4cf0f4c1 req-4c268963-5080-426f-862a-fc5f22db6bd6 service nova] Enqueued Resource ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 with Priority: HIGHEST for action security_group_members [ 924.180514] env[70013]: INFO networking_nsxv3.common.synchronization [req-bd5b4c1b-4f3f-4068-95a1-995f4cf0f4c1 req-4c268963-5080-426f-862a-fc5f22db6bd6 service nova] Enqueued Resource ID: ad1f3bb4-6fad-4f75-ad98-b53b3676f111 with Priority: HIGHEST for action port [ 924.184388] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 with Priority: HIGHEST for action security_group_rules [ 924.184388] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 with Priority: HIGHEST for action security_group_members [ 924.184388] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad1f3bb4-6fad-4f75-ad98-b53b3676f111 with Priority: HIGHEST for action port [ 924.184388] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb27dbe1-6f26-411f-bcfc-69daca38eb24 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.184388] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.184388] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb27dbe1-6f26-411f-bcfc-69daca38eb24 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.184388] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.184388] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad1f3bb4-6fad-4f75-ad98-b53b3676f111 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.184388] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad1f3bb4-6fad-4f75-ad98-b53b3676f111" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.184388] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad1f3bb4-6fad-4f75-ad98-b53b3676f111" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.184388] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad1f3bb4-6fad-4f75-ad98-b53b3676f111" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.184388] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad1f3bb4-6fad-4f75-ad98-b53b3676f111',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.265540] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.379336] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cacdb940-f750-4543-85f6-4b3fda0b646e [ 924.379396] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.380297] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.380297] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.380297] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.380297] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.380297] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cacdb940-f750-4543-85f6-4b3fda0b646e already deleted. [ 924.380297] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cacdb940-f750-4543-85f6-4b3fda0b646e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.651677] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.651869] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.651980] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.652264] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.652307] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.652417] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b is going to be updated. [ 924.680774] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.680964] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.681152] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.681362] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.681928] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.689206] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ad1f3bb4-6fad-4f75-ad98-b53b3676f111 with status ACTIVE [ 924.689438] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.689572] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.689634] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.689853] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.689949] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.690140] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.690235] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.690293] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.690449] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.690518] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.690698] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.690788] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.690846] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.690982] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.691164] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.691255] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ad1f3bb4-6fad-4f75-ad98-b53b3676f111 is going to be updated. [ 924.694139] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: IN_PROGRESS for 2s [ 924.715438] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.715438] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.715438] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.715438] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.715438] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.715438] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad1f3bb4-6fad-4f75-ad98-b53b3676f111" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.720372] env[70013]: INFO networking_nsxv3.common.synchronization [req-57a59576-14ab-49c9-9c2b-c87f4b756353 req-baccd775-29ee-4f21-92f6-68aeef655505 tempest-MultipleCreateTestJSON-634477930 tempest-MultipleCreateTestJSON-634477930-project-member] Enqueued Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_members [ 924.721307] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGHEST for action security_group_members [ 924.721307] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.721452] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.771334] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.771334] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.771334] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.771334] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.771334] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.771334] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 is going to be updated. [ 924.816904] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.817154] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.817242] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.817513] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.817737] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.831260] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 in Status: IN_PROGRESS for 2s [ 926.705817] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: SUCCESS [ 926.705817] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.705817] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.705817] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.705817] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.705817] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.705817] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.705817] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.705817] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.705817] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.843926] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 in Status: SUCCESS [ 926.844251] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.844429] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.844674] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.844865] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.844983] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.845062] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.845220] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.845336] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.845385] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.845484] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.846320] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.846659] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.846827] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.846922] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.846997] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.849168] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.849168] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.849168] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.210903] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.210903] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.210903] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.210903] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.210903] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.210903] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.210903] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.210903] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.210903] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.210903] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.210903] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b is going to be updated. [ 927.237350] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.237350] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.237350] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.237350] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.237350] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.246417] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: IN_PROGRESS for 2s [ 927.349181] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb27dbe1-6f26-411f-bcfc-69daca38eb24 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.349359] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.351181] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.856573] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.313414] env[70013]: INFO networking_nsxv3.common.synchronization [req-68f7e086-feb1-4b0e-b967-c09b34bcf1db req-ef01f63b-cb50-4d00-8072-b30b0af0ec8a tempest-ServerActionsTestJSON-1661939768 tempest-ServerActionsTestJSON-1661939768-project-member] Enqueued Resource ID: 0776053c-3635-4232-86b2-1a586b64e542 with Priority: HIGHEST for action security_group_members [ 928.313937] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0776053c-3635-4232-86b2-1a586b64e542 with Priority: HIGHEST for action security_group_members [ 928.318017] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0776053c-3635-4232-86b2-1a586b64e542 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.318017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.318017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.318017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.318017] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.318017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.318017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.318017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.318017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.318017] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0776053c-3635-4232-86b2-1a586b64e542',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.359961] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.360202] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.360301] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.360538] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.360665] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.360801] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 is going to be updated. [ 928.407658] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.407749] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.407793] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.407979] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.408205] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.421786] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 in Status: IN_PROGRESS for 2s [ 928.822881] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.822951] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.822983] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.823588] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.823588] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.823588] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.823761] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.823761] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.823865] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.824997] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.824997] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0776053c-3635-4232-86b2-1a586b64e542 already deleted. [ 928.824997] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.836034] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.836221] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-885" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.836350] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-885" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.836591] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-885" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.837263] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.837442] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.837568] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.837792] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.837940] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.838167] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 928.838291] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 928.838403] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 928.838524] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 928.838642] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 928.838752] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 928.838885] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 928.857437] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 928.857746] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 928.857815] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 928.857950] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-885" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.858329] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-d1869b01-6eea-468c-ac71-153c8eeda8ca taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.858513] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-d1869b01-6eea-468c-ac71-153c8eeda8ca" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.858660] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-d1869b01-6eea-468c-ac71-153c8eeda8ca" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.859015] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-d1869b01-6eea-468c-ac71-153c8eeda8ca" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.859184] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1869b01-6eea-468c-ac71-153c8eeda8ca',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.257375] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b in Status: SUCCESS [ 929.257639] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b deletion is rescheduled due to dependency. [ 929.258073] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.362056] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.362056] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.362056] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.362461] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.362569] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.362731] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port d1869b01-6eea-468c-ac71-153c8eeda8ca not found, creating... [ 929.363019] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.363221] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.363339] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.363557] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.363743] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.364080] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.364251] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.364370] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.364591] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.364729] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.364874] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: d1869b01-6eea-468c-ac71-153c8eeda8ca is going to be created. [ 929.386919] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.387156] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.387292] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.387641] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.387949] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.388288] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-d1869b01-6eea-468c-ac71-153c8eeda8ca" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.342690] env[70013]: INFO networking_nsxv3.common.synchronization [req-68f7e086-feb1-4b0e-b967-c09b34bcf1db req-f6c2b0b8-e68c-4600-9013-d0cc85f19cac service nova] Enqueued Resource ID: 0776053c-3635-4232-86b2-1a586b64e542 with Priority: HIGHEST for action security_group_rules [ 930.343022] env[70013]: INFO networking_nsxv3.common.synchronization [req-68f7e086-feb1-4b0e-b967-c09b34bcf1db req-f6c2b0b8-e68c-4600-9013-d0cc85f19cac service nova] Enqueued Resource ID: 0776053c-3635-4232-86b2-1a586b64e542 with Priority: HIGHEST for action security_group_members [ 930.346019] env[70013]: INFO networking_nsxv3.common.synchronization [req-68f7e086-feb1-4b0e-b967-c09b34bcf1db req-f6c2b0b8-e68c-4600-9013-d0cc85f19cac service nova] Enqueued Resource ID: d1869b01-6eea-468c-ac71-153c8eeda8ca with Priority: HIGHEST for action port [ 930.346019] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0776053c-3635-4232-86b2-1a586b64e542 with Priority: HIGHEST for action security_group_rules [ 930.346019] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0776053c-3635-4232-86b2-1a586b64e542 with Priority: HIGHEST for action security_group_members [ 930.346019] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1869b01-6eea-468c-ac71-153c8eeda8ca with Priority: HIGHEST for action port [ 930.346019] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0776053c-3635-4232-86b2-1a586b64e542 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.346019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.346019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.346019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.346019] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0776053c-3635-4232-86b2-1a586b64e542',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.346566] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0776053c-3635-4232-86b2-1a586b64e542 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.346741] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.346741] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.346953] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.347132] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.347234] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.347341] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.347516] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.347607] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.347701] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0776053c-3635-4232-86b2-1a586b64e542',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.348670] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1869b01-6eea-468c-ac71-153c8eeda8ca taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.350528] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1869b01-6eea-468c-ac71-153c8eeda8ca" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.350528] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1869b01-6eea-468c-ac71-153c8eeda8ca" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.350528] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1869b01-6eea-468c-ac71-153c8eeda8ca" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.350528] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1869b01-6eea-468c-ac71-153c8eeda8ca',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.430698] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 in Status: SUCCESS [ 930.430947] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.431131] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.431381] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.431571] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.431711] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.431852] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.431959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.432065] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.432163] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.852978] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0776053c-3635-4232-86b2-1a586b64e542',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.854797] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0776053c-3635-4232-86b2-1a586b64e542 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.854895] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.855074] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d1869b01-6eea-468c-ac71-153c8eeda8ca with status ACTIVE [ 930.855275] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.855393] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.855477] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.855713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.855883] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.855989] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.856301] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.856301] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.856411] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.856450] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.856688] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.856769] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.856805] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.857186] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.857186] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.857186] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d1869b01-6eea-468c-ac71-153c8eeda8ca is going to be updated. [ 930.887024] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.887260] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.887318] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.887601] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.887811] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.888036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1869b01-6eea-468c-ac71-153c8eeda8ca" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.935133] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.359529] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0776053c-3635-4232-86b2-1a586b64e542',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.437345] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.867567] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.867767] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.867846] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.868082] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.868174] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.868276] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0776053c-3635-4232-86b2-1a586b64e542 is going to be created. [ 931.897109] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.897325] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.897325] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.897545] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.897708] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.909868] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0776053c-3635-4232-86b2-1a586b64e542 in Status: UNINITIALIZED for 2s [ 931.941668] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.942054] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.942391] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.942734] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.942922] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.943173] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 is going to be updated. [ 931.971976] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.972971] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.973254] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.973594] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.973826] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.985759] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 in Status: IN_PROGRESS for 2s [ 932.400507] env[70013]: INFO networking_nsxv3.common.synchronization [req-fc70e12b-61ca-4960-834d-ce5ce953214a req-fe9b75e4-d908-4661-874c-ee638e1f35cd tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 with Priority: HIGHEST for action security_group_members [ 932.400507] env[70013]: INFO networking_nsxv3.common.synchronization [req-fc70e12b-61ca-4960-834d-ce5ce953214a req-fe9b75e4-d908-4661-874c-ee638e1f35cd tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: 35104466-92f1-4e6a-9df0-55e3f828079c with Priority: HIGHEST for action security_group_members [ 932.400895] env[70013]: INFO networking_nsxv3.common.synchronization [req-fc70e12b-61ca-4960-834d-ce5ce953214a req-fe9b75e4-d908-4661-874c-ee638e1f35cd tempest-SecurityGroupsTestJSON-917701892 tempest-SecurityGroupsTestJSON-917701892-project-member] Enqueued Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_members [ 932.401087] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 with Priority: HIGHEST for action security_group_members [ 932.401442] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35104466-92f1-4e6a-9df0-55e3f828079c with Priority: HIGHEST for action security_group_members [ 932.401442] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGHEST for action security_group_members [ 932.402434] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1197cb6b-f6f8-4e0a-8b93-e11877f2e915 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.402434] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.402434] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.402434] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.402434] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.402434] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.402434] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.404212] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.404212] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.404212] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1197cb6b-f6f8-4e0a-8b93-e11877f2e915',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.404212] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-35104466-92f1-4e6a-9df0-55e3f828079c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.404212] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.404212] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.404212] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.404212] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.404212] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.404212] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.404570] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.404570] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.404570] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35104466-92f1-4e6a-9df0-55e3f828079c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.405744] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.405744] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.405744] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.405744] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.406037] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.406037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.406037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.406199] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.406199] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.406295] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.640819] env[70013]: INFO networking_nsxv3.common.synchronization [req-e69847cc-877f-4186-afc9-55debae9dd34 req-a0b9f842-ba11-4ab8-aa7e-6a987608c7eb tempest-ImagesTestJSON-851757871 tempest-ImagesTestJSON-851757871-project-member] Enqueued Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 932.641410] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 932.641734] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.641862] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.641929] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.643493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.646760] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.646897] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.646969] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.647206] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.647268] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.647364] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.907945] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.908555] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.908757] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.909140] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.915075] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.915075] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.915075] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.915075] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.933142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.933246] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.933383] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.933450] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.933655] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.934566] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.934566] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 is going to be updated. [ 932.934828] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.935013] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.955058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.955058] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.955058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.955058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.955058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.955058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.955058] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35104466-92f1-4e6a-9df0-55e3f828079c is going to be updated. [ 932.955058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.955058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.975197] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.975197] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.975197] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.975197] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.975197] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.975197] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.975197] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d47d19df-e406-4c01-9cf0-1110c7c55440 is going to be updated. [ 932.975661] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.976014] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.976232] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.976581] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.976837] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.986021] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.986021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.986021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.986021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.986021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.986639] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 in Status: IN_PROGRESS for 2s [ 932.991531] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35104466-92f1-4e6a-9df0-55e3f828079c in Status: IN_PROGRESS for 2s [ 933.001061] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.001141] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.002524] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.002524] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.002524] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.017632] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: IN_PROGRESS for 2s [ 933.116868] env[70013]: INFO networking_nsxv3.common.synchronization [None req-03d91022-04ab-4d55-845c-68dfe9da1c24 None None] Enqueued Resource ID: 037907cb-8e63-494e-a673-a76d274febc1 with Priority: HIGHEST for action port [ 933.117823] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 037907cb-8e63-494e-a673-a76d274febc1 with Priority: HIGHEST for action port [ 933.118246] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-037907cb-8e63-494e-a673-a76d274febc1 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.118540] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-037907cb-8e63-494e-a673-a76d274febc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.118656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-037907cb-8e63-494e-a673-a76d274febc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.118959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-037907cb-8e63-494e-a673-a76d274febc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.119520] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('037907cb-8e63-494e-a673-a76d274febc1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.149265] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.620929] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 037907cb-8e63-494e-a673-a76d274febc1 [ 933.622990] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.622990] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.622990] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.622990] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.622990] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.622990] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:037907cb-8e63-494e-a673-a76d274febc1 already deleted. [ 933.622990] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-037907cb-8e63-494e-a673-a76d274febc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.654950] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.919033] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0776053c-3635-4232-86b2-1a586b64e542 in Status: SUCCESS [ 933.919033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.919212] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.919521] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.919720] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.919842] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.919895] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.920056] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.920205] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.920262] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.920305] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0776053c-3635-4232-86b2-1a586b64e542',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.994461] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 in Status: SUCCESS [ 933.994461] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.994461] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.994635] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.994891] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.994948] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.995047] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.995164] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.995381] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.995381] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.157746] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.157890] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.157978] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.158221] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.158317] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.158417] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 is going to be updated. [ 934.183594] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.183755] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.183801] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.184082] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.184273] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.192132] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: IN_PROGRESS for 2s [ 934.422433] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0776053c-3635-4232-86b2-1a586b64e542',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.497455] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.925463] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0776053c-3635-4232-86b2-1a586b64e542: rpc.has_security_group_logging(os_id): False [ 934.944769] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.944769] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.944769] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.944769] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.944769] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.944769] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.944769] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.944769] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.944769] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.944769] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.944769] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0776053c-3635-4232-86b2-1a586b64e542 is going to be created. [ 934.995163] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 in Status: SUCCESS [ 934.995344] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 deletion is rescheduled due to dependency. [ 934.995474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.000531] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35104466-92f1-4e6a-9df0-55e3f828079c in Status: SUCCESS [ 935.000820] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35104466-92f1-4e6a-9df0-55e3f828079c deletion is rescheduled due to dependency. [ 935.000992] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.001454] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.004599] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.005055] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.005188] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.005492] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.005898] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.016263] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0776053c-3635-4232-86b2-1a586b64e542 in Status: IN_PROGRESS for 2s [ 935.025174] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d47d19df-e406-4c01-9cf0-1110c7c55440 in Status: SUCCESS [ 935.025174] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d47d19df-e406-4c01-9cf0-1110c7c55440 deletion is rescheduled due to dependency. [ 935.025339] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.349565] env[70013]: INFO networking_nsxv3.common.synchronization [None req-99463826-f984-4e1e-a5b1-11e3c9d7e022 None None] Enqueued Resource ID: 65f89cf8-95f6-4e94-a5ef-6cdddc726f5b with Priority: HIGHEST for action port [ 935.352402] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65f89cf8-95f6-4e94-a5ef-6cdddc726f5b with Priority: HIGHEST for action port [ 935.352402] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-65f89cf8-95f6-4e94-a5ef-6cdddc726f5b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.352402] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65f89cf8-95f6-4e94-a5ef-6cdddc726f5b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.352402] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65f89cf8-95f6-4e94-a5ef-6cdddc726f5b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.352402] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65f89cf8-95f6-4e94-a5ef-6cdddc726f5b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.352402] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65f89cf8-95f6-4e94-a5ef-6cdddc726f5b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.504499] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.504748] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.504748] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.504927] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.505033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.505140] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 is going to be updated. [ 935.533540] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.533808] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.534144] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.534622] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.534867] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.543848] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 in Status: IN_PROGRESS for 2s [ 935.853684] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 65f89cf8-95f6-4e94-a5ef-6cdddc726f5b [ 935.853946] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.854261] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.854392] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.854638] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.854730] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.854831] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:65f89cf8-95f6-4e94-a5ef-6cdddc726f5b already deleted. [ 935.854916] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65f89cf8-95f6-4e94-a5ef-6cdddc726f5b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.202489] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: SUCCESS [ 936.203528] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.032294] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0776053c-3635-4232-86b2-1a586b64e542 in Status: SUCCESS [ 937.032531] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.553805] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 in Status: SUCCESS [ 937.554196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.554388] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.554613] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.555476] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.555699] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.555789] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.555905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.555997] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.556111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.556356] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb27dbe1-6f26-411f-bcfc-69daca38eb24 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.556462] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.556520] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.556667] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.556817] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.556926] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.556982] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.557136] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.557211] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.557295] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.557387] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.059184] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb27dbe1-6f26-411f-bcfc-69daca38eb24: rpc.has_security_group_logging(os_id): False [ 938.076834] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.077036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.077036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.077260] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.077356] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.077809] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.077926] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.077991] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.078169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.078248] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.078427] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.078524] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.078657] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.078724] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.078889] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.078980] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.079089] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.079152] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.079353] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.079422] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.079484] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 is going to be created. [ 938.130092] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.130221] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.130275] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.130488] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.130676] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.140435] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 in Status: IN_PROGRESS for 2s [ 938.156945] env[70013]: INFO networking_nsxv3.common.synchronization [req-918c5dbb-3c98-40e8-b485-8462131620ea req-a7077579-ed03-44e7-b85f-7ab53be9eeee tempest-ServersTestJSON-1543902807 tempest-ServersTestJSON-1543902807-project-member] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 938.157509] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 938.157823] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.157946] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.159841] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.160245] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.162064] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.162271] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.162395] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.162633] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.162780] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.162949] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.495974] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-250 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.496414] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-250" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.497374] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-250" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.497374] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-250" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.497374] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.497374] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.497692] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.498945] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.498945] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.498945] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 938.498945] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 938.498945] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 938.499416] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 938.499416] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 938.499573] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 938.499632] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 938.520142] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 938.520142] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 938.520142] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 938.520142] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-250" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.520142] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-4a49418e-b633-42e9-b84c-6a2ece113e59 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.520142] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-4a49418e-b633-42e9-b84c-6a2ece113e59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.520142] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-4a49418e-b633-42e9-b84c-6a2ece113e59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.520142] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-4a49418e-b633-42e9-b84c-6a2ece113e59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.520460] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a49418e-b633-42e9-b84c-6a2ece113e59',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.669454] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.023255] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.023661] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.023820] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.024157] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.024421] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.024789] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 4a49418e-b633-42e9-b84c-6a2ece113e59 not found, creating... [ 939.025161] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.025350] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.025481] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.025738] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.025886] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.026220] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.026422] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.026624] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.026905] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.027069] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.027221] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 4a49418e-b633-42e9-b84c-6a2ece113e59 is going to be created. [ 939.046152] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.046480] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.046632] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.046933] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.047384] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.047631] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-4a49418e-b633-42e9-b84c-6a2ece113e59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.172233] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.674752] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.678310] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.678310] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.678310] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.678310] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.678310] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a is going to be updated. [ 939.707499] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.707499] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.707499] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.707499] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.707499] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.717421] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: IN_PROGRESS for 2s [ 939.779047] env[70013]: INFO networking_nsxv3.common.synchronization [req-918c5dbb-3c98-40e8-b485-8462131620ea req-5fda84d6-9bad-4813-a901-7146b9b4ba7e service nova] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_rules [ 939.779047] env[70013]: INFO networking_nsxv3.common.synchronization [req-918c5dbb-3c98-40e8-b485-8462131620ea req-5fda84d6-9bad-4813-a901-7146b9b4ba7e service nova] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 939.779047] env[70013]: INFO networking_nsxv3.common.synchronization [req-918c5dbb-3c98-40e8-b485-8462131620ea req-5fda84d6-9bad-4813-a901-7146b9b4ba7e service nova] Enqueued Resource ID: 4a49418e-b633-42e9-b84c-6a2ece113e59 with Priority: HIGHEST for action port [ 939.779642] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_rules [ 939.779941] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 939.780225] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a49418e-b633-42e9-b84c-6a2ece113e59 with Priority: HIGHEST for action port [ 939.780744] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.781028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.781233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.781611] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.781808] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.782827] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.783087] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.783882] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a49418e-b633-42e9-b84c-6a2ece113e59 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.783882] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a49418e-b633-42e9-b84c-6a2ece113e59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.783882] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a49418e-b633-42e9-b84c-6a2ece113e59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.787091] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a49418e-b633-42e9-b84c-6a2ece113e59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.787091] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a49418e-b633-42e9-b84c-6a2ece113e59',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.152599] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 in Status: SUCCESS [ 940.152874] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.152979] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.153432] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.153432] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.288103] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.289250] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.289250] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a49418e-b633-42e9-b84c-6a2ece113e59 with status ACTIVE [ 940.289250] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.289478] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.289478] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.289665] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.289768] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.290115] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.290254] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.290322] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.290496] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.290592] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.290778] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.290872] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.290922] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.291082] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.291188] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.291262] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a49418e-b633-42e9-b84c-6a2ece113e59 is going to be updated. [ 940.310418] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.310757] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.310757] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.310928] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.311096] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.311268] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a49418e-b633-42e9-b84c-6a2ece113e59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.655691] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb27dbe1-6f26-411f-bcfc-69daca38eb24 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.655937] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.656079] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.656421] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.656691] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.656855] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.657034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.657230] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.657389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.657574] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.657733] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.982879] env[70013]: INFO networking_nsxv3.common.synchronization [req-32aa862b-af80-4023-a33d-9302cbc5fb88 req-c90b1c07-1888-438e-8ae9-102e7dc0d292 tempest-ServersNegativeTestMultiTenantJSON-14989621 tempest-ServersNegativeTestMultiTenantJSON-14989621-project-member] Enqueued Resource ID: 0baaf456-ebe4-4944-a9c9-d343bf8ebd98 with Priority: HIGHEST for action security_group_members [ 940.983590] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0baaf456-ebe4-4944-a9c9-d343bf8ebd98 with Priority: HIGHEST for action security_group_members [ 940.984093] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.984874] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.985034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.985326] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.985549] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.985840] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.986012] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.986288] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.986462] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.986627] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0baaf456-ebe4-4944-a9c9-d343bf8ebd98',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.160754] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb27dbe1-6f26-411f-bcfc-69daca38eb24 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.161030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.161159] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.162624] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.162624] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.162624] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.162624] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.162624] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.162624] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.162624] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.162624] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb27dbe1-6f26-411f-bcfc-69daca38eb24 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.162624] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.163247] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.163247] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.163247] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.163247] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.163247] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.163247] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.163502] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.163502] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.163568] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.330549] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-694 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.330836] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-694" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.330927] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-694" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.331265] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-694" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.331539] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.331706] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.331835] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.332076] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.332243] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.332471] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 941.332586] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 941.332698] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 941.332813] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 941.332923] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 941.333046] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 941.333184] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 941.350019] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 941.350150] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 941.350290] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 941.350522] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-694" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.350913] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-85556b4a-7248-4583-8362-b471b8b0abbe taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.351375] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-85556b4a-7248-4583-8362-b471b8b0abbe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.351375] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-85556b4a-7248-4583-8362-b471b8b0abbe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.351695] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-85556b4a-7248-4583-8362-b471b8b0abbe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.352268] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85556b4a-7248-4583-8362-b471b8b0abbe',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.489027] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.489224] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.489301] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.489519] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.489608] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.489804] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.489896] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.489958] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.490127] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.490200] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.490283] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0baaf456-ebe4-4944-a9c9-d343bf8ebd98 already deleted. [ 941.490371] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.649489] env[70013]: INFO networking_nsxv3.common.synchronization [req-52468b9b-9f69-4190-b7fb-0a6185aa7dca req-48e15f8b-3d90-4f4a-b745-b77d0009e78e tempest-ListImageFiltersTestJSON-2117804784 tempest-ListImageFiltersTestJSON-2117804784-project-member] Enqueued Resource ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 with Priority: HIGHEST for action security_group_members [ 941.650835] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 with Priority: HIGHEST for action security_group_members [ 941.650835] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.650835] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.650835] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.650835] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.651250] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.651250] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.651250] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.657560] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.657560] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.657560] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf5314a2-236c-4f4a-b8ea-d899149c1ea8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.666239] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb27dbe1-6f26-411f-bcfc-69daca38eb24: rpc.has_security_group_logging(os_id): False [ 941.684694] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.684870] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.684952] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.685214] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.685307] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.685562] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.685671] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.685736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.685922] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.686153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.686230] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.689576] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.689655] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.689929] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.690124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.690275] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.690849] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.690849] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.690849] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.690849] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.690849] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 is going to be updated. [ 941.727528] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: SUCCESS [ 941.728019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.728019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.728135] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.728358] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.728489] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.728601] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.728750] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.728839] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.728942] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.747729] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.747729] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.747729] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.747729] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.748166] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.758479] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 in Status: IN_PROGRESS for 2s [ 941.855662] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.855895] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.856038] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.856331] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.856490] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.856652] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 85556b4a-7248-4583-8362-b471b8b0abbe not found, creating... [ 941.856918] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.857083] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.857210] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.857483] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.857618] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.857981] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.858183] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.858307] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.858525] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.858681] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.858866] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 85556b4a-7248-4583-8362-b471b8b0abbe is going to be created. [ 941.878963] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.879346] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.879563] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.879868] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.882057] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.882057] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-85556b4a-7248-4583-8362-b471b8b0abbe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.163649] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf5314a2-236c-4f4a-b8ea-d899149c1ea8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.232776] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.591885] env[70013]: INFO networking_nsxv3.common.synchronization [req-32aa862b-af80-4023-a33d-9302cbc5fb88 req-c42ef8ef-ac1a-4c5a-9677-7687f62033c3 service nova] Enqueued Resource ID: 0baaf456-ebe4-4944-a9c9-d343bf8ebd98 with Priority: HIGHEST for action security_group_rules [ 942.591885] env[70013]: INFO networking_nsxv3.common.synchronization [req-32aa862b-af80-4023-a33d-9302cbc5fb88 req-c42ef8ef-ac1a-4c5a-9677-7687f62033c3 service nova] Enqueued Resource ID: 0baaf456-ebe4-4944-a9c9-d343bf8ebd98 with Priority: HIGHEST for action security_group_members [ 942.592042] env[70013]: INFO networking_nsxv3.common.synchronization [req-32aa862b-af80-4023-a33d-9302cbc5fb88 req-c42ef8ef-ac1a-4c5a-9677-7687f62033c3 service nova] Enqueued Resource ID: 85556b4a-7248-4583-8362-b471b8b0abbe with Priority: HIGHEST for action port [ 942.595721] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0baaf456-ebe4-4944-a9c9-d343bf8ebd98 with Priority: HIGHEST for action security_group_rules [ 942.595721] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0baaf456-ebe4-4944-a9c9-d343bf8ebd98 with Priority: HIGHEST for action security_group_members [ 942.595721] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85556b4a-7248-4583-8362-b471b8b0abbe with Priority: HIGHEST for action port [ 942.595721] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0baaf456-ebe4-4944-a9c9-d343bf8ebd98 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.595721] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.595721] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.595721] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.595721] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0baaf456-ebe4-4944-a9c9-d343bf8ebd98',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.595721] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.595721] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.595721] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.595721] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.595721] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.595721] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.595721] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.596267] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.596267] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.596267] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0baaf456-ebe4-4944-a9c9-d343bf8ebd98',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.597680] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-85556b4a-7248-4583-8362-b471b8b0abbe taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.597680] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85556b4a-7248-4583-8362-b471b8b0abbe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.597680] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85556b4a-7248-4583-8362-b471b8b0abbe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.597680] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85556b4a-7248-4583-8362-b471b8b0abbe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.597680] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85556b4a-7248-4583-8362-b471b8b0abbe',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.667644] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf5314a2-236c-4f4a-b8ea-d899149c1ea8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.735313] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.099998] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0baaf456-ebe4-4944-a9c9-d343bf8ebd98',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.101066] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.101194] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.102715] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 85556b4a-7248-4583-8362-b471b8b0abbe with status ACTIVE [ 943.102893] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.103024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.103080] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.103289] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.103448] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.103634] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.103728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.103794] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.103961] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.104082] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.104249] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.104396] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.104472] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.104649] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.104649] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.104767] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 85556b4a-7248-4583-8362-b471b8b0abbe is going to be updated. [ 943.124357] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.124521] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.124595] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.124859] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.124996] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.125294] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85556b4a-7248-4583-8362-b471b8b0abbe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.171960] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.171960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.171960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.171960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.171960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.171960] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 is going to be updated. [ 943.209296] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.209443] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.209538] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.209760] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.209916] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.218241] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 in Status: IN_PROGRESS for 2s [ 943.237878] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.238076] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.238139] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.238335] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.238429] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.238531] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a is going to be updated. [ 943.273141] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.273263] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.273339] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.273620] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.273774] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.286410] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: IN_PROGRESS for 2s [ 943.602939] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0baaf456-ebe4-4944-a9c9-d343bf8ebd98',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.771045] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 in Status: SUCCESS [ 943.771045] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.771045] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.773141] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.773324] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.104700] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.104924] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.104924] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.105166] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.105258] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.105359] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0baaf456-ebe4-4944-a9c9-d343bf8ebd98 is going to be created. [ 944.128411] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.128592] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.128720] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.128851] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.129039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.141120] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0baaf456-ebe4-4944-a9c9-d343bf8ebd98 in Status: UNINITIALIZED for 2s [ 944.275635] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb27dbe1-6f26-411f-bcfc-69daca38eb24 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.276089] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.276089] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.276266] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.276463] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.276590] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.276656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.277154] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.277268] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.277590] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.277646] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.780824] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb27dbe1-6f26-411f-bcfc-69daca38eb24 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.781072] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.781211] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.781594] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.781859] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.782017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.782114] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.782319] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.782443] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.782550] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.782732] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb27dbe1-6f26-411f-bcfc-69daca38eb24 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.782829] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.782903] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.783118] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.783276] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.783405] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.783466] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.783934] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.784086] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.784246] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.784395] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.232269] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 in Status: SUCCESS [ 945.232503] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.290623] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb27dbe1-6f26-411f-bcfc-69daca38eb24: rpc.has_security_group_logging(os_id): False [ 945.302508] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: SUCCESS [ 945.302731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.302888] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.303153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.303324] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.304462] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.304462] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.304462] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.304462] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.304462] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.304462] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.311389] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.311389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.311389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.311389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.311389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.311389] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.311389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.311389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.311389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.311389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.311389] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.311389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.311389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.311389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.311389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.312369] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.312369] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.312369] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.312369] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.312564] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.312564] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 is going to be updated. [ 945.367857] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.368135] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.368135] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.368135] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.368135] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.381649] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 in Status: IN_PROGRESS for 2s [ 945.808034] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.808221] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.808305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.808545] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.808748] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.809421] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.809648] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.809955] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.811323] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.811323] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.811501] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.811715] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.811803] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.812049] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.812316] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.812479] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.812621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.812863] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.813058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.813230] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.813438] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.154732] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0baaf456-ebe4-4944-a9c9-d343bf8ebd98 in Status: UNINITIALIZED for 4s [ 946.157874] env[70013]: INFO networking_nsxv3.common.synchronization [req-8d64c5e5-0b9b-445c-95f1-ee3f96483c58 req-adc4cd6b-11df-4c4f-92a1-d7310d24e28d tempest-MigrationsAdminTest-81604366 tempest-MigrationsAdminTest-81604366-project-member] Enqueued Resource ID: 572a619a-3a59-46a6-bc09-5d754276356e with Priority: HIGHEST for action security_group_members [ 946.159645] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 572a619a-3a59-46a6-bc09-5d754276356e with Priority: HIGHEST for action security_group_members [ 946.160225] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-572a619a-3a59-46a6-bc09-5d754276356e taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.160637] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.160967] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.161365] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.161672] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.161998] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.162349] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.164869] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.164869] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.164869] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('572a619a-3a59-46a6-bc09-5d754276356e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.317791] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f422a68f-f64a-4d93-9deb-289ae02aea3a: rpc.has_security_group_logging(os_id): False [ 946.334968] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.334968] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.334968] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.334968] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.354021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.354021] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.354021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.354021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.354021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.354021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.354021] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.354021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.354021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.354021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.354021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.354021] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.354021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.354021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.354618] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.354618] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.354618] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a is going to be updated. [ 946.417277] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.417500] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.417581] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.417879] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.418023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.429574] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: IN_PROGRESS for 2s [ 946.667289] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('572a619a-3a59-46a6-bc09-5d754276356e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.169763] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('572a619a-3a59-46a6-bc09-5d754276356e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.395103] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 in Status: SUCCESS [ 947.395362] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.672969] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.673142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.673212] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.673485] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.673585] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.673736] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 572a619a-3a59-46a6-bc09-5d754276356e is going to be updated. [ 947.705297] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.705464] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.705585] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.705896] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.706091] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.715785] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 572a619a-3a59-46a6-bc09-5d754276356e in Status: IN_PROGRESS for 2s [ 948.167099] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0baaf456-ebe4-4944-a9c9-d343bf8ebd98 in Status: SUCCESS [ 948.167099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.167099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.167099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.167099] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.167099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.167099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.167099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.167099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.167099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.167099] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0baaf456-ebe4-4944-a9c9-d343bf8ebd98',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.445600] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: SUCCESS [ 948.445899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.669333] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.669475] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.669542] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.669765] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.669934] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.670063] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.670105] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.670290] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.670354] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.670433] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.670578] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.670674] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.670732] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.670872] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.671030] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.671194] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.671249] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.671392] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.671519] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.671569] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.671670] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0baaf456-ebe4-4944-a9c9-d343bf8ebd98',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.173757] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0baaf456-ebe4-4944-a9c9-d343bf8ebd98: rpc.has_security_group_logging(os_id): False [ 949.191513] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.191513] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.191654] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.191850] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.191961] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.192554] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.192554] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.192554] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.192554] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.192554] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.192780] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.192833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.192881] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.193031] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.193110] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.193308] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.193402] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.193503] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.193651] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.193724] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.193810] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0baaf456-ebe4-4944-a9c9-d343bf8ebd98 is going to be created. [ 949.257439] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.257606] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.257745] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.257978] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.258188] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.267395] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0baaf456-ebe4-4944-a9c9-d343bf8ebd98 in Status: IN_PROGRESS for 2s [ 949.727122] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 572a619a-3a59-46a6-bc09-5d754276356e in Status: SUCCESS [ 949.728071] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.125767] env[70013]: INFO networking_nsxv3.common.synchronization [req-6e3be2e0-ed2d-4f12-a045-7a7827de5c8a req-ae4e706a-f34f-4d68-b16c-c8fa8645b27f tempest-ServersTestJSON-1543902807 tempest-ServersTestJSON-1543902807-project-member] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 951.126319] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 951.126633] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.126764] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.126833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.127220] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.128280] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.128280] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.128280] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.128280] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.128280] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.128538] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.279400] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0baaf456-ebe4-4944-a9c9-d343bf8ebd98 in Status: SUCCESS [ 951.282361] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.631110] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.133408] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.640279] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.640279] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.640279] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.640279] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.640279] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.640279] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a is going to be updated. [ 952.668243] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.668243] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.668243] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.668243] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.668243] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.692805] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: IN_PROGRESS for 2s [ 954.277522] env[70013]: INFO networking_nsxv3.common.synchronization [req-5794bdfe-c1c0-4369-90b6-55a9721ce667 req-f5875337-0e9d-4e76-8599-6cebb74dd9b2 tempest-ImagesOneServerNegativeTestJSON-165560685 tempest-ImagesOneServerNegativeTestJSON-165560685-project-member] Enqueued Resource ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 with Priority: HIGHEST for action security_group_members [ 954.278535] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 with Priority: HIGHEST for action security_group_members [ 954.278888] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d98818b-c2c5-4242-8897-fe65d03027a5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.280222] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.280222] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.280222] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.283095] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.283276] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.283357] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.283905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.283905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.283905] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d98818b-c2c5-4242-8897-fe65d03027a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.707856] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: SUCCESS [ 954.707968] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.713645] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-796 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.717124] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-796" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.717124] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-796" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.717124] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-796" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.717307] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.717625] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.717909] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.718305] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.718842] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.719249] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 954.719497] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 954.719721] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 954.719933] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 954.720178] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 954.720383] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 954.720686] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 954.724518] env[70013]: INFO networking_nsxv3.common.synchronization [req-2beff42b-96e6-4cf4-a9a7-dd1edd86c239 req-c0e130d2-1180-4d91-9151-46cd93add006 tempest-ServersAdminTestJSON-1183835690 tempest-ServersAdminTestJSON-1183835690-project-member] Enqueued Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_members [ 954.728304] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 with Priority: HIGHEST for action security_group_members [ 954.728304] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a7abade-e912-4196-b558-4a6d4ece9b29 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.728304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.728304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.728304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.728304] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.728304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.728304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.728304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.728304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.728304] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a7abade-e912-4196-b558-4a6d4ece9b29',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.741691] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 954.741691] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 954.741691] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 954.741691] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-796" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.741691] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-b33639f5-3e61-4132-80fc-92b074ea22a1 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.741691] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-b33639f5-3e61-4132-80fc-92b074ea22a1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.742151] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-b33639f5-3e61-4132-80fc-92b074ea22a1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.742250] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-b33639f5-3e61-4132-80fc-92b074ea22a1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.742412] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b33639f5-3e61-4132-80fc-92b074ea22a1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.785613] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.785811] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.785811] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.785979] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.806205] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.806604] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.806788] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.806928] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.807240] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.807340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.807496] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 is going to be updated. [ 954.843723] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.843870] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.843971] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.844192] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.844346] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.852880] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 in Status: IN_PROGRESS for 2s [ 955.234452] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.234702] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.234818] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.235094] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.246083] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.246083] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.246083] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.246362] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.246470] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.246754] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port b33639f5-3e61-4132-80fc-92b074ea22a1 not found, creating... [ 955.247215] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.247492] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.247690] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.247950] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.248115] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.248452] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.248620] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.248745] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.248976] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.249151] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.249271] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: b33639f5-3e61-4132-80fc-92b074ea22a1 is going to be created. [ 955.260254] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.260541] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.260687] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.260784] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.260984] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.261074] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.261170] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 is going to be updated. [ 955.269897] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.270199] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.270278] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.270487] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.270782] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.271019] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-b33639f5-3e61-4132-80fc-92b074ea22a1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.285306] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.285645] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.285645] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.285739] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.285827] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.292820] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: IN_PROGRESS for 2s [ 955.548829] env[70013]: INFO networking_nsxv3.common.synchronization [req-3934d595-d839-4960-9b8a-34524dd8de84 req-dfd2476c-ecff-4a17-bd08-78f5620cebef tempest-ServersNegativeTestMultiTenantJSON-14989621 tempest-ServersNegativeTestMultiTenantJSON-14989621-project-member] Enqueued Resource ID: 0baaf456-ebe4-4944-a9c9-d343bf8ebd98 with Priority: HIGHEST for action security_group_members [ 955.549389] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0baaf456-ebe4-4944-a9c9-d343bf8ebd98 with Priority: HIGHEST for action security_group_members [ 955.549703] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.549832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.549899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.550649] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.551178] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.551178] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.551178] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.551178] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.551178] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.551427] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0baaf456-ebe4-4944-a9c9-d343bf8ebd98',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.628110] env[70013]: INFO networking_nsxv3.common.synchronization [req-bf71c047-d989-498e-be15-5729b23343ab req-28a0c07b-d68f-437b-a0cf-a7096a5a5688 tempest-ListServerFiltersTestJSON-1686378133 tempest-ListServerFiltersTestJSON-1686378133-project-member] Enqueued Resource ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 with Priority: HIGHEST for action security_group_members [ 955.628786] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 with Priority: HIGHEST for action security_group_members [ 955.630238] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb27dbe1-6f26-411f-bcfc-69daca38eb24 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.630393] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.630467] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.630683] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.630848] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.630944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.631021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.631167] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.631257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.631344] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.967451] env[70013]: INFO networking_nsxv3.common.synchronization [req-5794bdfe-c1c0-4369-90b6-55a9721ce667 req-aa362649-3550-4215-969e-295adfd106e6 service nova] Enqueued Resource ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 with Priority: HIGHEST for action security_group_rules [ 955.967609] env[70013]: INFO networking_nsxv3.common.synchronization [req-5794bdfe-c1c0-4369-90b6-55a9721ce667 req-aa362649-3550-4215-969e-295adfd106e6 service nova] Enqueued Resource ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 with Priority: HIGHEST for action security_group_members [ 955.967693] env[70013]: INFO networking_nsxv3.common.synchronization [req-5794bdfe-c1c0-4369-90b6-55a9721ce667 req-aa362649-3550-4215-969e-295adfd106e6 service nova] Enqueued Resource ID: b33639f5-3e61-4132-80fc-92b074ea22a1 with Priority: HIGHEST for action port [ 955.968212] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 with Priority: HIGHEST for action security_group_rules [ 955.968338] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 with Priority: HIGHEST for action security_group_members [ 955.968429] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b33639f5-3e61-4132-80fc-92b074ea22a1 with Priority: HIGHEST for action port [ 955.968698] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d98818b-c2c5-4242-8897-fe65d03027a5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.968850] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.969025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.969364] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.969364] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d98818b-c2c5-4242-8897-fe65d03027a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.971574] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d98818b-c2c5-4242-8897-fe65d03027a5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.971574] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.971574] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-b33639f5-3e61-4132-80fc-92b074ea22a1 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.971574] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b33639f5-3e61-4132-80fc-92b074ea22a1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.971574] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b33639f5-3e61-4132-80fc-92b074ea22a1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.971574] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b33639f5-3e61-4132-80fc-92b074ea22a1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.971574] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b33639f5-3e61-4132-80fc-92b074ea22a1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.053868] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.053946] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.054029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.054701] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.054701] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.054701] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.054701] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.054701] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.054964] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.054964] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.054964] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0baaf456-ebe4-4944-a9c9-d343bf8ebd98 is going to be updated. [ 956.081217] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.081350] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.081350] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.081651] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.081799] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.089281] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0baaf456-ebe4-4944-a9c9-d343bf8ebd98 in Status: IN_PROGRESS for 2s [ 956.133704] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.473052] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d98818b-c2c5-4242-8897-fe65d03027a5 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.473391] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.473391] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b33639f5-3e61-4132-80fc-92b074ea22a1 with status ACTIVE [ 956.473464] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.473595] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.473664] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.473882] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.473973] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.474194] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.474300] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.474420] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.474650] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.474650] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.474802] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.474867] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.474929] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.475115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.475193] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.475276] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b33639f5-3e61-4132-80fc-92b074ea22a1 is going to be updated. [ 956.494513] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.494614] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.494699] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.494829] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.494969] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.495154] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b33639f5-3e61-4132-80fc-92b074ea22a1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.636318] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.862054] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 in Status: SUCCESS [ 956.862054] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 deletion is rescheduled due to dependency. [ 956.862054] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.862054] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.862296] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.862444] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.862559] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.862621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.862780] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.863646] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.863646] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d98818b-c2c5-4242-8897-fe65d03027a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.143514] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.143514] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.143514] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.143514] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.143514] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.143514] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 is going to be updated. [ 957.175488] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.175648] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.175702] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.175916] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.176083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.183919] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 in Status: IN_PROGRESS for 2s [ 957.302076] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 in Status: SUCCESS [ 957.302319] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a7abade-e912-4196-b558-4a6d4ece9b29 deletion is rescheduled due to dependency. [ 957.302437] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a7abade-e912-4196-b558-4a6d4ece9b29" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.368213] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d98818b-c2c5-4242-8897-fe65d03027a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.870852] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d98818b-c2c5-4242-8897-fe65d03027a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.098506] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0baaf456-ebe4-4944-a9c9-d343bf8ebd98 in Status: SUCCESS [ 958.098727] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0baaf456-ebe4-4944-a9c9-d343bf8ebd98 deletion is rescheduled due to dependency. [ 958.098836] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.373237] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.373448] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.373448] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.373713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.373798] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.373906] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 is going to be updated. [ 958.400673] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.400803] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.400874] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.401824] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.401824] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.412764] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 in Status: IN_PROGRESS for 2s [ 959.193479] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 in Status: SUCCESS [ 959.193820] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.425748] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 in Status: SUCCESS [ 960.426112] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.426293] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.426654] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.426918] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.427077] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.427169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.427392] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.427509] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.427637] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.428211] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d98818b-c2c5-4242-8897-fe65d03027a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.827359] env[70013]: INFO networking_nsxv3.common.synchronization [req-8574ffd1-be59-4ef9-b08e-a3ef415d87c5 req-37980a4a-e6b6-4c4f-8009-9dbbc1cf13b4 tempest-AttachVolumeNegativeTest-680083968 tempest-AttachVolumeNegativeTest-680083968-project-member] Enqueued Resource ID: 0e60d03d-8d54-4827-87a6-1c1728f166fe with Priority: HIGHEST for action security_group_members [ 960.827971] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e60d03d-8d54-4827-87a6-1c1728f166fe with Priority: HIGHEST for action security_group_members [ 960.828351] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e60d03d-8d54-4827-87a6-1c1728f166fe taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.828482] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.828597] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.828871] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.829054] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.829158] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.829223] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.829378] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.829615] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.829615] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e60d03d-8d54-4827-87a6-1c1728f166fe',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.932083] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d98818b-c2c5-4242-8897-fe65d03027a5 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.932083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.932083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.932083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.932083] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.932083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.932083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.932083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.932494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.932494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.932494] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d98818b-c2c5-4242-8897-fe65d03027a5 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.932494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.932615] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.933787] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.933787] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.933787] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.933787] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.933787] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.933787] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.933787] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.933787] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d98818b-c2c5-4242-8897-fe65d03027a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.163193] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-145 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.163193] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-145" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.163193] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-145" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.163193] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-145" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.163193] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.163193] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.163765] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.164154] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.164439] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.164855] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 961.165140] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 961.165356] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 961.165576] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 961.165827] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 961.166073] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 961.166325] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 961.195298] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 961.195535] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 961.195579] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 961.195754] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-145" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.196118] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-998637c4-6d93-4002-8b56-ee2560a41b7c taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.197125] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-998637c4-6d93-4002-8b56-ee2560a41b7c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.197125] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-998637c4-6d93-4002-8b56-ee2560a41b7c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.197125] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-998637c4-6d93-4002-8b56-ee2560a41b7c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.197125] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('998637c4-6d93-4002-8b56-ee2560a41b7c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.333342] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.333342] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.333342] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.333560] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.333683] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.333892] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.333992] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.334069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.334224] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.334305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.334390] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e60d03d-8d54-4827-87a6-1c1728f166fe already deleted. [ 961.334468] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.436409] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d98818b-c2c5-4242-8897-fe65d03027a5: rpc.has_security_group_logging(os_id): False [ 961.453247] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.453394] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.453467] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.453718] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.453812] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.454057] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.454200] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.454270] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.454429] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.454509] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.454734] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.454833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.454894] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.455055] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.455132] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.455331] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.455424] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.455484] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.455633] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.455984] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.456122] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 is going to be updated. [ 961.525033] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.525221] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.525221] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.525381] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.525557] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.537437] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 in Status: IN_PROGRESS for 2s [ 961.700339] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.700603] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.700780] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.701108] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.701271] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.701501] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 998637c4-6d93-4002-8b56-ee2560a41b7c not found, creating... [ 961.701745] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.701912] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.702047] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.702302] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.702453] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.702765] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.702987] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.703206] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.703431] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.703586] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.703767] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 998637c4-6d93-4002-8b56-ee2560a41b7c is going to be created. [ 961.722775] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.722992] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.723132] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.723399] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.723709] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.723877] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-998637c4-6d93-4002-8b56-ee2560a41b7c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.424909] env[70013]: INFO networking_nsxv3.common.synchronization [req-8574ffd1-be59-4ef9-b08e-a3ef415d87c5 req-056a386b-639d-4b82-a815-10e217cc82d3 service nova] Enqueued Resource ID: 0e60d03d-8d54-4827-87a6-1c1728f166fe with Priority: HIGHEST for action security_group_rules [ 962.425220] env[70013]: INFO networking_nsxv3.common.synchronization [req-8574ffd1-be59-4ef9-b08e-a3ef415d87c5 req-056a386b-639d-4b82-a815-10e217cc82d3 service nova] Enqueued Resource ID: 0e60d03d-8d54-4827-87a6-1c1728f166fe with Priority: HIGHEST for action security_group_members [ 962.425607] env[70013]: INFO networking_nsxv3.common.synchronization [req-8574ffd1-be59-4ef9-b08e-a3ef415d87c5 req-056a386b-639d-4b82-a815-10e217cc82d3 service nova] Enqueued Resource ID: 998637c4-6d93-4002-8b56-ee2560a41b7c with Priority: HIGHEST for action port [ 962.426616] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e60d03d-8d54-4827-87a6-1c1728f166fe with Priority: HIGHEST for action security_group_rules [ 962.426864] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e60d03d-8d54-4827-87a6-1c1728f166fe with Priority: HIGHEST for action security_group_members [ 962.427055] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 998637c4-6d93-4002-8b56-ee2560a41b7c with Priority: HIGHEST for action port [ 962.427401] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e60d03d-8d54-4827-87a6-1c1728f166fe taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.427574] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.427634] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.427850] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.427992] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e60d03d-8d54-4827-87a6-1c1728f166fe',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.429159] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e60d03d-8d54-4827-87a6-1c1728f166fe taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.429302] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.429393] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.429589] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.429784] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.429909] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.430088] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.430163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.430257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.430347] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e60d03d-8d54-4827-87a6-1c1728f166fe',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.431689] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-998637c4-6d93-4002-8b56-ee2560a41b7c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.431824] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-998637c4-6d93-4002-8b56-ee2560a41b7c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.431894] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-998637c4-6d93-4002-8b56-ee2560a41b7c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.432161] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-998637c4-6d93-4002-8b56-ee2560a41b7c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.432240] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('998637c4-6d93-4002-8b56-ee2560a41b7c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.934638] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e60d03d-8d54-4827-87a6-1c1728f166fe taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.934638] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.934638] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e60d03d-8d54-4827-87a6-1c1728f166fe',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.936946] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 998637c4-6d93-4002-8b56-ee2560a41b7c with status ACTIVE [ 962.936946] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.936946] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.936946] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.936946] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.936946] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.936946] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.936946] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.936946] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.936946] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.936946] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.937502] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.937502] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.937502] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.937502] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.937729] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.937729] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 998637c4-6d93-4002-8b56-ee2560a41b7c is going to be updated. [ 962.959914] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.960149] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.960251] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.960478] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.960633] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.960893] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-998637c4-6d93-4002-8b56-ee2560a41b7c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.322769] env[70013]: INFO networking_nsxv3.common.synchronization [req-222c660a-f0d4-47ec-96a2-a48b7df4ca47 req-20dbe99b-214f-47da-ad4e-bdd2b8a8d554 tempest-AttachVolumeTestJSON-972861423 tempest-AttachVolumeTestJSON-972861423-project-member] Enqueued Resource ID: f3b902d5-ffa1-4a45-b449-3b726cf76855 with Priority: HIGHEST for action security_group_members [ 963.323310] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b902d5-ffa1-4a45-b449-3b726cf76855 with Priority: HIGHEST for action security_group_members [ 963.323676] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b902d5-ffa1-4a45-b449-3b726cf76855 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.323814] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.323883] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.326247] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.326438] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.326611] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.326611] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.326812] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.326898] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.327000] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3b902d5-ffa1-4a45-b449-3b726cf76855',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.440526] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e60d03d-8d54-4827-87a6-1c1728f166fe',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.549083] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 in Status: SUCCESS [ 963.549083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.616965] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-3 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.617149] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.617274] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.617556] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.617824] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.617986] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.618503] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.618580] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.618751] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.618970] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 963.619112] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 963.619238] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 963.619357] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 963.619541] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 963.619586] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 963.619714] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 963.637874] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 963.637874] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 963.637874] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 963.637874] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.638323] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-9c6dd76e-1819-4f40-b5b1-e548b0c947ec taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.638421] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-9c6dd76e-1819-4f40-b5b1-e548b0c947ec" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.638840] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-9c6dd76e-1819-4f40-b5b1-e548b0c947ec" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.639034] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-9c6dd76e-1819-4f40-b5b1-e548b0c947ec" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.639034] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c6dd76e-1819-4f40-b5b1-e548b0c947ec',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.829595] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.829781] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.830529] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.830826] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.830933] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.831181] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.831289] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.831353] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.831592] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.831686] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.831723] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3b902d5-ffa1-4a45-b449-3b726cf76855 already deleted. [ 963.831826] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.944017] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.944017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.944017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.944017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.944017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.944017] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e60d03d-8d54-4827-87a6-1c1728f166fe is going to be created. [ 963.970679] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.970679] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.970679] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.970679] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.970679] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.979634] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e60d03d-8d54-4827-87a6-1c1728f166fe in Status: UNINITIALIZED for 2s [ 964.143092] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.143306] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.143519] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.143841] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.144041] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.144361] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 9c6dd76e-1819-4f40-b5b1-e548b0c947ec not found, creating... [ 964.144726] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.144916] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.145053] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.145311] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.145464] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.145782] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.145974] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.147288] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.147732] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.148017] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.148209] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 9c6dd76e-1819-4f40-b5b1-e548b0c947ec is going to be created. [ 964.168938] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.169103] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.169250] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.169538] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.170441] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.170739] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-9c6dd76e-1819-4f40-b5b1-e548b0c947ec" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.894469] env[70013]: INFO networking_nsxv3.common.synchronization [req-222c660a-f0d4-47ec-96a2-a48b7df4ca47 req-dac950df-ccb9-4495-aec1-88fccc61253d service nova] Enqueued Resource ID: f3b902d5-ffa1-4a45-b449-3b726cf76855 with Priority: HIGHEST for action security_group_rules [ 964.894673] env[70013]: INFO networking_nsxv3.common.synchronization [req-222c660a-f0d4-47ec-96a2-a48b7df4ca47 req-dac950df-ccb9-4495-aec1-88fccc61253d service nova] Enqueued Resource ID: f3b902d5-ffa1-4a45-b449-3b726cf76855 with Priority: HIGHEST for action security_group_members [ 964.894832] env[70013]: INFO networking_nsxv3.common.synchronization [req-222c660a-f0d4-47ec-96a2-a48b7df4ca47 req-dac950df-ccb9-4495-aec1-88fccc61253d service nova] Enqueued Resource ID: 9c6dd76e-1819-4f40-b5b1-e548b0c947ec with Priority: HIGHEST for action port [ 964.895387] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b902d5-ffa1-4a45-b449-3b726cf76855 with Priority: HIGHEST for action security_group_rules [ 964.895526] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b902d5-ffa1-4a45-b449-3b726cf76855 with Priority: HIGHEST for action security_group_members [ 964.895625] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c6dd76e-1819-4f40-b5b1-e548b0c947ec with Priority: HIGHEST for action port [ 964.895888] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3b902d5-ffa1-4a45-b449-3b726cf76855 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.896125] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.896226] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.896467] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.896587] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3b902d5-ffa1-4a45-b449-3b726cf76855',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.897665] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b902d5-ffa1-4a45-b449-3b726cf76855 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.897870] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.897971] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.898202] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.898395] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.898525] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.898609] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.898785] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.899313] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.899471] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3b902d5-ffa1-4a45-b449-3b726cf76855',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.900355] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c6dd76e-1819-4f40-b5b1-e548b0c947ec taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.900503] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c6dd76e-1819-4f40-b5b1-e548b0c947ec" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.900601] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c6dd76e-1819-4f40-b5b1-e548b0c947ec" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.900789] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c6dd76e-1819-4f40-b5b1-e548b0c947ec" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.900902] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c6dd76e-1819-4f40-b5b1-e548b0c947ec',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.402820] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3b902d5-ffa1-4a45-b449-3b726cf76855',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.403991] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b902d5-ffa1-4a45-b449-3b726cf76855 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.404134] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.404516] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c6dd76e-1819-4f40-b5b1-e548b0c947ec with status ACTIVE [ 965.404747] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.404900] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.404900] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.405114] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.405202] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.405395] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.405494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.405558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.405717] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.405800] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.405983] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.406092] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.406155] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.406315] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.406387] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.406471] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c6dd76e-1819-4f40-b5b1-e548b0c947ec is going to be updated. [ 965.427338] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.427489] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.427577] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.427819] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.427960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.428142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c6dd76e-1819-4f40-b5b1-e548b0c947ec" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.905978] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3b902d5-ffa1-4a45-b449-3b726cf76855',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.948316] env[70013]: INFO networking_nsxv3.common.synchronization [req-b2fa7283-44b0-45f0-b985-0c7266eabb30 req-8b752102-a9ea-434e-8bab-cfcf95747552 tempest-ServerRescueTestJSON-1890363448 tempest-ServerRescueTestJSON-1890363448-project-member] Enqueued Resource ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 with Priority: HIGHEST for action security_group_members [ 965.948316] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 with Priority: HIGHEST for action security_group_members [ 965.948316] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6998667-5e88-456a-b064-7faf8fc4bfd8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.948316] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.948316] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.948316] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.949207] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.949477] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.949640] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.949905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.950105] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.950310] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6998667-5e88-456a-b064-7faf8fc4bfd8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.988947] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e60d03d-8d54-4827-87a6-1c1728f166fe in Status: SUCCESS [ 965.989204] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.989368] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.989587] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.989790] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.989911] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.989977] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.990144] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.990227] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.990320] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.990399] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e60d03d-8d54-4827-87a6-1c1728f166fe',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.259722] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-782 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.259921] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-782" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.260057] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-782" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.260406] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-782" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.260664] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.263845] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.264096] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.264440] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.264666] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.264969] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 966.265126] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 966.265246] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 966.265403] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 966.265554] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 966.265694] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 966.265883] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 966.284777] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 966.285649] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 966.285649] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 966.285649] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-782" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.286336] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-46420036-2adf-470d-b041-a6487903eed6 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.286336] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-46420036-2adf-470d-b041-a6487903eed6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.286336] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-46420036-2adf-470d-b041-a6487903eed6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.286503] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-46420036-2adf-470d-b041-a6487903eed6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.286628] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46420036-2adf-470d-b041-a6487903eed6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.408071] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.408409] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.408409] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.408521] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.408614] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.408712] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3b902d5-ffa1-4a45-b449-3b726cf76855 is going to be created. [ 966.432038] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.432190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.432309] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.432524] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.432672] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.442246] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b902d5-ffa1-4a45-b449-3b726cf76855 in Status: UNINITIALIZED for 2s [ 966.452873] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.453024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.453968] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.453968] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.453968] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.453968] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.454269] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.454269] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.454339] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.454379] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.455045] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 already deleted. [ 966.455045] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.492702] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e60d03d-8d54-4827-87a6-1c1728f166fe',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.788590] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.788899] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.789102] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.789422] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.789577] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.789738] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 46420036-2adf-470d-b041-a6487903eed6 not found, creating... [ 966.790029] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.790203] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.790942] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.790942] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.790942] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.790942] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.791317] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.791317] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.791742] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.791896] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.792175] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 46420036-2adf-470d-b041-a6487903eed6 is going to be created. [ 966.812475] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.812748] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.813734] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.813734] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.813734] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.813952] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-46420036-2adf-470d-b041-a6487903eed6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.995236] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e60d03d-8d54-4827-87a6-1c1728f166fe: rpc.has_security_group_logging(os_id): False [ 967.017662] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.017872] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.017872] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.018609] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.018609] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.018609] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.018609] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.018609] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.018900] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.018900] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.018900] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e60d03d-8d54-4827-87a6-1c1728f166fe is going to be created. [ 967.080377] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.080600] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.080674] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.080945] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.081215] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.090996] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e60d03d-8d54-4827-87a6-1c1728f166fe in Status: IN_PROGRESS for 2s [ 967.130870] env[70013]: INFO networking_nsxv3.common.synchronization [req-6bd36a00-0167-46d5-b140-016c87ee80de req-a4bc27d7-1796-4831-b1e9-d7d01d468d94 tempest-ImagesOneServerNegativeTestJSON-165560685 tempest-ImagesOneServerNegativeTestJSON-165560685-project-member] Enqueued Resource ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 with Priority: HIGHEST for action security_group_members [ 967.131745] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 with Priority: HIGHEST for action security_group_members [ 967.131826] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d98818b-c2c5-4242-8897-fe65d03027a5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.132217] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.132217] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.132487] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.132487] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.132602] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.132636] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.132838] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.132900] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.133015] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d98818b-c2c5-4242-8897-fe65d03027a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.496428] env[70013]: INFO networking_nsxv3.common.synchronization [req-b2fa7283-44b0-45f0-b985-0c7266eabb30 req-d0c92aea-6857-4806-b179-02a75eab5e06 service nova] Enqueued Resource ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 with Priority: HIGHEST for action security_group_rules [ 967.496428] env[70013]: INFO networking_nsxv3.common.synchronization [req-b2fa7283-44b0-45f0-b985-0c7266eabb30 req-d0c92aea-6857-4806-b179-02a75eab5e06 service nova] Enqueued Resource ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 with Priority: HIGHEST for action security_group_members [ 967.496428] env[70013]: INFO networking_nsxv3.common.synchronization [req-b2fa7283-44b0-45f0-b985-0c7266eabb30 req-d0c92aea-6857-4806-b179-02a75eab5e06 service nova] Enqueued Resource ID: 46420036-2adf-470d-b041-a6487903eed6 with Priority: HIGHEST for action port [ 967.496428] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 with Priority: HIGHEST for action security_group_rules [ 967.496428] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 with Priority: HIGHEST for action security_group_members [ 967.496428] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46420036-2adf-470d-b041-a6487903eed6 with Priority: HIGHEST for action port [ 967.504023] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6998667-5e88-456a-b064-7faf8fc4bfd8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.504023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.504023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.504023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.504023] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6998667-5e88-456a-b064-7faf8fc4bfd8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.504023] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6998667-5e88-456a-b064-7faf8fc4bfd8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.504023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.504023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.504023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.504023] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.504023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.504023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.504023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.504023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.504023] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6998667-5e88-456a-b064-7faf8fc4bfd8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.510128] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-46420036-2adf-470d-b041-a6487903eed6 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.510474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46420036-2adf-470d-b041-a6487903eed6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.510673] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46420036-2adf-470d-b041-a6487903eed6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.510968] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46420036-2adf-470d-b041-a6487903eed6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.511188] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46420036-2adf-470d-b041-a6487903eed6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.637939] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.637939] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.637939] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.637939] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.637939] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.637939] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.637939] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.637939] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.637939] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.637939] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.637939] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 is going to be updated. [ 967.665591] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.665772] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.665772] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.665894] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.666082] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.674288] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 in Status: IN_PROGRESS for 2s [ 968.010654] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6998667-5e88-456a-b064-7faf8fc4bfd8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.014386] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6998667-5e88-456a-b064-7faf8fc4bfd8 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.014543] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.014760] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 46420036-2adf-470d-b041-a6487903eed6 with status ACTIVE [ 968.014967] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.015129] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.015214] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.015485] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.015642] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.015834] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.015904] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.016030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.016207] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.016294] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.016662] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.016662] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.016662] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.016915] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.016915] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.016997] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 46420036-2adf-470d-b041-a6487903eed6 is going to be updated. [ 968.064256] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.064435] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.064516] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.064871] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.065068] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.065278] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46420036-2adf-470d-b041-a6487903eed6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.459356] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b902d5-ffa1-4a45-b449-3b726cf76855 in Status: SUCCESS [ 968.459600] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.459793] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.461736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.461736] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.461736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.461736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.461736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.461736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.461736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.461736] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3b902d5-ffa1-4a45-b449-3b726cf76855',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.513036] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6998667-5e88-456a-b064-7faf8fc4bfd8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.629091] env[70013]: INFO networking_nsxv3.common.synchronization [req-bb04f738-433b-4f3f-935f-0e91cfc54d40 req-be197ed0-b238-4326-a161-1e215c7a126b tempest-ServerExternalEventsTest-408165301 tempest-ServerExternalEventsTest-408165301-project-member] Enqueued Resource ID: 9772853b-4ff5-4a28-8f4f-b2e864434ff9 with Priority: HIGHEST for action security_group_members [ 968.629091] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9772853b-4ff5-4a28-8f4f-b2e864434ff9 with Priority: HIGHEST for action security_group_members [ 968.629091] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9772853b-4ff5-4a28-8f4f-b2e864434ff9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.629091] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.629091] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.629091] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.629091] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.629091] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.629091] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.629091] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.629091] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.629091] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9772853b-4ff5-4a28-8f4f-b2e864434ff9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.964913] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3b902d5-ffa1-4a45-b449-3b726cf76855',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.021595] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.021826] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.021826] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.022116] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.022319] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.022319] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 is going to be created. [ 969.051932] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.052109] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.052233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.052406] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.052569] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.062980] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 in Status: UNINITIALIZED for 2s [ 969.101539] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e60d03d-8d54-4827-87a6-1c1728f166fe in Status: SUCCESS [ 969.101728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.104995] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-701 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.105277] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.105409] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.105751] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.106048] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.106212] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.106377] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.106614] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.106844] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.106996] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 969.107131] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 969.107298] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 969.107435] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 969.107533] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 969.107644] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 969.107787] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 969.125498] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 969.125693] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 969.125842] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 969.126061] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-701" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.126501] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-7e0131ef-1dbf-4927-bc49-8bcea6a75d84 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.126687] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-7e0131ef-1dbf-4927-bc49-8bcea6a75d84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.126809] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-7e0131ef-1dbf-4927-bc49-8bcea6a75d84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.127255] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-7e0131ef-1dbf-4927-bc49-8bcea6a75d84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.127488] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e0131ef-1dbf-4927-bc49-8bcea6a75d84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.131416] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.131606] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.131784] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.132332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.132332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.132553] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.132553] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.132553] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.132991] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.132991] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.133166] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9772853b-4ff5-4a28-8f4f-b2e864434ff9 already deleted. [ 969.133166] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.466266] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3b902d5-ffa1-4a45-b449-3b726cf76855: rpc.has_security_group_logging(os_id): False [ 969.483401] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.483598] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.483643] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.484013] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.484458] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.484458] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.484458] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.484458] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.484678] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.484678] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.484931] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3b902d5-ffa1-4a45-b449-3b726cf76855 is going to be created. [ 969.538533] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.538947] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.538947] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.539038] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.539172] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.548772] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3b902d5-ffa1-4a45-b449-3b726cf76855 in Status: IN_PROGRESS for 2s [ 969.631822] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.632224] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.632326] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.632540] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.632697] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.632860] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 7e0131ef-1dbf-4927-bc49-8bcea6a75d84 not found, creating... [ 969.633147] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.633304] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.633502] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.633814] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.633966] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.634908] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.635092] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.635219] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.635440] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.635577] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.635837] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 7e0131ef-1dbf-4927-bc49-8bcea6a75d84 is going to be created. [ 969.662920] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.663221] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.663386] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.663671] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.664264] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.664264] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-7e0131ef-1dbf-4927-bc49-8bcea6a75d84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.683990] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 in Status: SUCCESS [ 969.684216] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 deletion is rescheduled due to dependency. [ 969.684335] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.072399] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 in Status: SUCCESS [ 971.076323] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.076323] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.076323] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.076323] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.076323] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.076323] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.076323] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.076323] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.076323] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.076323] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f6998667-5e88-456a-b064-7faf8fc4bfd8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.227674] env[70013]: INFO networking_nsxv3.common.synchronization [req-bb04f738-433b-4f3f-935f-0e91cfc54d40 req-d7e63734-27fb-4943-870d-cba6dfd412e5 service nova] Enqueued Resource ID: 9772853b-4ff5-4a28-8f4f-b2e864434ff9 with Priority: HIGHEST for action security_group_rules [ 971.228241] env[70013]: INFO networking_nsxv3.common.synchronization [req-bb04f738-433b-4f3f-935f-0e91cfc54d40 req-d7e63734-27fb-4943-870d-cba6dfd412e5 service nova] Enqueued Resource ID: 9772853b-4ff5-4a28-8f4f-b2e864434ff9 with Priority: HIGHEST for action security_group_members [ 971.232024] env[70013]: INFO networking_nsxv3.common.synchronization [req-bb04f738-433b-4f3f-935f-0e91cfc54d40 req-d7e63734-27fb-4943-870d-cba6dfd412e5 service nova] Enqueued Resource ID: 7e0131ef-1dbf-4927-bc49-8bcea6a75d84 with Priority: HIGHEST for action port [ 971.232024] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9772853b-4ff5-4a28-8f4f-b2e864434ff9 with Priority: HIGHEST for action security_group_rules [ 971.232024] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9772853b-4ff5-4a28-8f4f-b2e864434ff9 with Priority: HIGHEST for action security_group_members [ 971.232024] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e0131ef-1dbf-4927-bc49-8bcea6a75d84 with Priority: HIGHEST for action port [ 971.232024] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9772853b-4ff5-4a28-8f4f-b2e864434ff9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.232024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.232024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.232024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.232024] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9772853b-4ff5-4a28-8f4f-b2e864434ff9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.232024] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9772853b-4ff5-4a28-8f4f-b2e864434ff9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.232024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.232024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.232024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.233337] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.233337] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.233533] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.233630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.233786] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.233899] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9772853b-4ff5-4a28-8f4f-b2e864434ff9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.234856] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e0131ef-1dbf-4927-bc49-8bcea6a75d84 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.234999] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e0131ef-1dbf-4927-bc49-8bcea6a75d84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.235326] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e0131ef-1dbf-4927-bc49-8bcea6a75d84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.235326] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e0131ef-1dbf-4927-bc49-8bcea6a75d84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.235442] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e0131ef-1dbf-4927-bc49-8bcea6a75d84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.561557] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3b902d5-ffa1-4a45-b449-3b726cf76855 in Status: SUCCESS [ 971.561802] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.581020] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6998667-5e88-456a-b064-7faf8fc4bfd8 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.581020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.581020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.581020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.581020] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.581020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.581020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.581020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.581020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.581020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.581020] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6998667-5e88-456a-b064-7faf8fc4bfd8 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.581020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.581020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.581020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.581020] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.581020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.582099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.582099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.582099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.582099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.582099] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f6998667-5e88-456a-b064-7faf8fc4bfd8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.737172] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9772853b-4ff5-4a28-8f4f-b2e864434ff9 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.737392] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.737526] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9772853b-4ff5-4a28-8f4f-b2e864434ff9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.738421] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e0131ef-1dbf-4927-bc49-8bcea6a75d84 with status ACTIVE [ 971.738663] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.738786] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.738843] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.739013] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.739108] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.739291] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.739378] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.739442] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.739630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.739692] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.740057] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.740057] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.740057] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.740612] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.740767] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.740767] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e0131ef-1dbf-4927-bc49-8bcea6a75d84 is going to be updated. [ 971.762700] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.762827] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.762905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.763158] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.763274] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.763832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e0131ef-1dbf-4927-bc49-8bcea6a75d84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.087247] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f6998667-5e88-456a-b064-7faf8fc4bfd8: rpc.has_security_group_logging(os_id): False [ 972.104254] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.104254] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.104254] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.104448] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.104543] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.104830] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.104902] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.104902] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.107111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.107111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.107111] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.107111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.107111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.107111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.107111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.107111] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.107111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.107111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.107111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.107111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.107111] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 is going to be created. [ 972.169464] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.169621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.169693] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.169905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.170099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.179549] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 in Status: IN_PROGRESS for 2s [ 972.243027] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9772853b-4ff5-4a28-8f4f-b2e864434ff9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.748930] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.748930] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.748930] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.748930] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.748930] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.748930] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9772853b-4ff5-4a28-8f4f-b2e864434ff9 is going to be created. [ 972.771152] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.773710] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.773710] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.773710] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.773710] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.782421] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9772853b-4ff5-4a28-8f4f-b2e864434ff9 in Status: UNINITIALIZED for 2s [ 974.192778] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 in Status: SUCCESS [ 974.193152] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.747732] env[70013]: INFO networking_nsxv3.common.synchronization [None req-ab2cae36-e259-4797-ba52-518edf5baf9d None None] Enqueued Resource ID: 8a552f18-6c47-4406-bfdd-d37622f85a94 with Priority: HIGHEST for action port [ 974.748598] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a552f18-6c47-4406-bfdd-d37622f85a94 with Priority: HIGHEST for action port [ 974.748751] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a552f18-6c47-4406-bfdd-d37622f85a94 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.748872] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a552f18-6c47-4406-bfdd-d37622f85a94" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.748936] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a552f18-6c47-4406-bfdd-d37622f85a94" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.753500] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a552f18-6c47-4406-bfdd-d37622f85a94" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.753500] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a552f18-6c47-4406-bfdd-d37622f85a94',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.794418] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9772853b-4ff5-4a28-8f4f-b2e864434ff9 in Status: SUCCESS [ 974.796711] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.796711] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.796711] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.796711] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.796711] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.796711] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.796711] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.796711] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.796711] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.796711] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9772853b-4ff5-4a28-8f4f-b2e864434ff9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.258742] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8a552f18-6c47-4406-bfdd-d37622f85a94 [ 975.258742] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.258742] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.258742] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.258742] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.258742] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.258742] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8a552f18-6c47-4406-bfdd-d37622f85a94 already deleted. [ 975.258742] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a552f18-6c47-4406-bfdd-d37622f85a94" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.280655] env[70013]: INFO networking_nsxv3.common.synchronization [req-867eda26-e686-4ea5-a2b1-9a1a961f8d0c req-9480c537-e0ff-499b-9702-72c0fab708f0 tempest-FloatingIPsAssociationNegativeTestJSON-925045144 tempest-FloatingIPsAssociationNegativeTestJSON-925045144-project-member] Enqueued Resource ID: 33eb23fb-1e54-4510-ba50-bf9c982207a3 with Priority: HIGHEST for action security_group_members [ 975.281767] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33eb23fb-1e54-4510-ba50-bf9c982207a3 with Priority: HIGHEST for action security_group_members [ 975.281767] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-33eb23fb-1e54-4510-ba50-bf9c982207a3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.281767] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.281767] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.282039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.285044] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.285044] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.285044] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.285044] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.285044] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.285044] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33eb23fb-1e54-4510-ba50-bf9c982207a3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.299963] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9772853b-4ff5-4a28-8f4f-b2e864434ff9 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.300208] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.300208] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.300405] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.300580] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.300652] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.300711] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.300962] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.300962] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.301117] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.301269] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9772853b-4ff5-4a28-8f4f-b2e864434ff9 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.301428] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.301428] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.301577] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.301728] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.301822] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.301881] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.302701] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.302846] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.302989] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.303080] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9772853b-4ff5-4a28-8f4f-b2e864434ff9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.389373] env[70013]: INFO networking_nsxv3.common.synchronization [req-794eefb1-95ee-4305-b893-f9f2b3ba52cc req-1c04e212-7711-44a3-bbb0-df96caf9b544 tempest-ImagesTestJSON-851757871 tempest-ImagesTestJSON-851757871-project-member] Enqueued Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 975.389967] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 975.390136] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.390136] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.390270] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.390505] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.390674] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.390674] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.390674] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.390834] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.390910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.390999] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.747455] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-976 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.747719] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-976" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.747884] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-976" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.748842] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-976" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.749185] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.749403] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.749598] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.749897] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.750095] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.750355] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 975.750484] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 975.750625] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 975.750746] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 975.750902] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 975.751033] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 975.751207] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 975.769954] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 975.770215] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 975.770397] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 975.770648] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-976" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.771016] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-71a34572-9310-4b13-b628-322b0a2dcf71 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.771255] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-71a34572-9310-4b13-b628-322b0a2dcf71" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.771409] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-71a34572-9310-4b13-b628-322b0a2dcf71" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.771837] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-71a34572-9310-4b13-b628-322b0a2dcf71" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.772086] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71a34572-9310-4b13-b628-322b0a2dcf71',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.786170] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.786474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.786474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.786605] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.787298] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.787571] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.787686] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.787756] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.787925] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.788037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.788135] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33eb23fb-1e54-4510-ba50-bf9c982207a3 already deleted. [ 975.788520] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.807780] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9772853b-4ff5-4a28-8f4f-b2e864434ff9: rpc.has_security_group_logging(os_id): False [ 975.825617] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.825820] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.825820] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.826138] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.826138] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.826410] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.826516] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.826516] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.826692] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.826692] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.827030] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.827030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.827163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.827324] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.827324] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.827488] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.827708] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.827708] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.827926] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.827926] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.827926] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9772853b-4ff5-4a28-8f4f-b2e864434ff9 is going to be created. [ 975.884150] env[70013]: INFO networking_nsxv3.common.synchronization [None req-d31368f1-1035-48cf-a28f-3f36233fdd51 tempest-AttachInterfacesUnderV243Test-760224301 tempest-AttachInterfacesUnderV243Test-760224301-project-member] Enqueued Resource ID: bb3e5499-be65-479e-916c-2fb08083e417 with Priority: HIGHEST for action security_group_rules [ 975.884150] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.884150] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.884150] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.884150] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.884646] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.885534] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb3e5499-be65-479e-916c-2fb08083e417 with Priority: HIGHEST for action security_group_rules [ 975.890016] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb3e5499-be65-479e-916c-2fb08083e417 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.890016] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.890016] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.890016] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.890016] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb3e5499-be65-479e-916c-2fb08083e417',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.895154] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.895290] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.895493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.895613] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.895657] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.896265] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.896265] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.896265] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.896265] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.896265] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.896265] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 is going to be updated. [ 975.897941] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9772853b-4ff5-4a28-8f4f-b2e864434ff9 in Status: IN_PROGRESS for 2s [ 975.933365] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.933556] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.933627] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.933855] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.934033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.942114] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: IN_PROGRESS for 2s [ 976.020193] env[70013]: INFO networking_nsxv3.common.synchronization [None req-2f3edde6-7d4b-4ad0-85a1-b272ab734b1f tempest-AttachInterfacesUnderV243Test-760224301 tempest-AttachInterfacesUnderV243Test-760224301-project-member] Enqueued Resource ID: bb3e5499-be65-479e-916c-2fb08083e417 with Priority: HIGHEST for action security_group_rules [ 976.020595] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb3e5499-be65-479e-916c-2fb08083e417 with Priority: HIGHEST for action security_group_rules [ 976.020917] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb3e5499-be65-479e-916c-2fb08083e417 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.021047] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.280512] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.280922] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.280991] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.281264] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.281560] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.281779] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 71a34572-9310-4b13-b628-322b0a2dcf71 not found, creating... [ 976.282131] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.282379] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.282585] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.282888] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.283114] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.283518] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.283751] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.283962] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.284262] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.284519] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.284766] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 71a34572-9310-4b13-b628-322b0a2dcf71 is going to be created. [ 976.303206] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.303472] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.303559] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.303853] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.304146] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.304483] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-71a34572-9310-4b13-b628-322b0a2dcf71" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.409113] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.409340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.409830] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.411441] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.411547] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.411683] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb3e5499-be65-479e-916c-2fb08083e417 already deleted. [ 976.411805] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.411980] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.412202] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.412793] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb3e5499-be65-479e-916c-2fb08083e417',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.766759] env[70013]: INFO networking_nsxv3.common.synchronization [None req-cfdcefbc-c88d-4793-994a-19e99d71449f None None] Enqueued Resource ID: 3a03b67b-04a1-4bd2-b762-c75bd0a3db92 with Priority: HIGHEST for action port [ 976.769020] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a03b67b-04a1-4bd2-b762-c75bd0a3db92 with Priority: HIGHEST for action port [ 976.769020] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a03b67b-04a1-4bd2-b762-c75bd0a3db92 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.769020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a03b67b-04a1-4bd2-b762-c75bd0a3db92" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.769020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a03b67b-04a1-4bd2-b762-c75bd0a3db92" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.769020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a03b67b-04a1-4bd2-b762-c75bd0a3db92" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.769020] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a03b67b-04a1-4bd2-b762-c75bd0a3db92',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.935095] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.935267] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.935340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.935605] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.935726] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.935763] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb3e5499-be65-479e-916c-2fb08083e417 already deleted. [ 976.935824] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.154347] env[70013]: INFO networking_nsxv3.common.synchronization [req-867eda26-e686-4ea5-a2b1-9a1a961f8d0c req-ddc42f82-8e77-4c03-b10b-93dada857627 service nova] Enqueued Resource ID: 33eb23fb-1e54-4510-ba50-bf9c982207a3 with Priority: HIGHEST for action security_group_rules [ 977.154347] env[70013]: INFO networking_nsxv3.common.synchronization [req-867eda26-e686-4ea5-a2b1-9a1a961f8d0c req-ddc42f82-8e77-4c03-b10b-93dada857627 service nova] Enqueued Resource ID: 33eb23fb-1e54-4510-ba50-bf9c982207a3 with Priority: HIGHEST for action security_group_members [ 977.154347] env[70013]: INFO networking_nsxv3.common.synchronization [req-867eda26-e686-4ea5-a2b1-9a1a961f8d0c req-ddc42f82-8e77-4c03-b10b-93dada857627 service nova] Enqueued Resource ID: 71a34572-9310-4b13-b628-322b0a2dcf71 with Priority: HIGHEST for action port [ 977.154347] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33eb23fb-1e54-4510-ba50-bf9c982207a3 with Priority: HIGHEST for action security_group_rules [ 977.154347] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33eb23fb-1e54-4510-ba50-bf9c982207a3 with Priority: HIGHEST for action security_group_members [ 977.154347] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71a34572-9310-4b13-b628-322b0a2dcf71 with Priority: HIGHEST for action port [ 977.154347] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33eb23fb-1e54-4510-ba50-bf9c982207a3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.154347] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.154347] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.155393] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.155579] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33eb23fb-1e54-4510-ba50-bf9c982207a3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.156666] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-33eb23fb-1e54-4510-ba50-bf9c982207a3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.156923] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.157145] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.157493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.157751] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.157968] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.158134] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.158385] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.158591] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.163134] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33eb23fb-1e54-4510-ba50-bf9c982207a3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.167019] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-71a34572-9310-4b13-b628-322b0a2dcf71 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.167019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71a34572-9310-4b13-b628-322b0a2dcf71" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.167019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71a34572-9310-4b13-b628-322b0a2dcf71" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.167019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71a34572-9310-4b13-b628-322b0a2dcf71" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.167019] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71a34572-9310-4b13-b628-322b0a2dcf71',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.272493] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a03b67b-04a1-4bd2-b762-c75bd0a3db92 [ 977.273109] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.274186] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.274272] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.274485] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.274573] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.274669] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a03b67b-04a1-4bd2-b762-c75bd0a3db92 already deleted. [ 977.274797] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a03b67b-04a1-4bd2-b762-c75bd0a3db92" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.608311] env[70013]: INFO networking_nsxv3.common.synchronization [req-fdd2161a-597c-4591-b3fa-23d1cbc00384 req-41f5bb1f-3794-4ed2-9487-6df2c398ac47 tempest-ServerActionsTestOtherA-108106573 tempest-ServerActionsTestOtherA-108106573-project-member] Enqueued Resource ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 with Priority: HIGHEST for action security_group_members [ 977.609177] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 with Priority: HIGHEST for action security_group_members [ 977.609312] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d0cfefe-0851-47aa-9a55-0d92164acbc1 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.609448] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.609514] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.609768] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.609949] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.610169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.610236] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.610401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.610489] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.610585] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d0cfefe-0851-47aa-9a55-0d92164acbc1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.668541] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-33eb23fb-1e54-4510-ba50-bf9c982207a3 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.668778] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.668881] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33eb23fb-1e54-4510-ba50-bf9c982207a3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.669761] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71a34572-9310-4b13-b628-322b0a2dcf71 with status ACTIVE [ 977.669973] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.670113] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.670182] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.670415] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.670524] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.670719] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.670820] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.670886] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.671083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.671167] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.671355] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.671473] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.671541] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.671710] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.671796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.671916] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71a34572-9310-4b13-b628-322b0a2dcf71 is going to be updated. [ 977.694687] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.694835] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.694891] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.695145] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.695281] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.695438] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71a34572-9310-4b13-b628-322b0a2dcf71" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.910329] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9772853b-4ff5-4a28-8f4f-b2e864434ff9 in Status: SUCCESS [ 977.910560] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.920192] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.920399] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-353" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.920527] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-353" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.920812] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-353" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.921084] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.921247] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.921368] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.921591] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.921747] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.921977] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 977.922112] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 977.922228] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 977.922342] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 977.922458] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 977.922569] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 977.922703] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 977.942228] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 977.942433] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 977.942688] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 977.942976] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-353" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.943471] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-a805f6e6-6016-433a-b106-0e686f4bd6ef taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.943753] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-a805f6e6-6016-433a-b106-0e686f4bd6ef" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.943977] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-a805f6e6-6016-433a-b106-0e686f4bd6ef" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.945425] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-a805f6e6-6016-433a-b106-0e686f4bd6ef" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.945593] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a805f6e6-6016-433a-b106-0e686f4bd6ef',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.954618] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: SUCCESS [ 977.954786] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 deletion is rescheduled due to dependency. [ 977.954905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.113937] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.114157] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.114157] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.114395] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.114454] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.114683] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.114793] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.114830] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.114997] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.115093] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.115181] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 already deleted. [ 978.115261] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.174280] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33eb23fb-1e54-4510-ba50-bf9c982207a3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.448247] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.448497] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.448628] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.448927] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.449154] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.449332] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port a805f6e6-6016-433a-b106-0e686f4bd6ef not found, creating... [ 978.449649] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.449772] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.449890] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.450146] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.450291] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.450577] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.450737] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.450856] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.451089] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.451229] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.451374] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: a805f6e6-6016-433a-b106-0e686f4bd6ef is going to be created. [ 978.471628] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.471928] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.472042] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.472369] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.472639] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.472831] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-a805f6e6-6016-433a-b106-0e686f4bd6ef" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.677655] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.678052] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.678052] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.678052] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.678176] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.678316] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33eb23fb-1e54-4510-ba50-bf9c982207a3 is going to be created. [ 978.700782] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.701083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.701083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.701225] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.701625] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.710775] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33eb23fb-1e54-4510-ba50-bf9c982207a3 in Status: UNINITIALIZED for 2s [ 979.163514] env[70013]: INFO networking_nsxv3.common.synchronization [req-fdd2161a-597c-4591-b3fa-23d1cbc00384 req-e91e43ae-e600-4b1b-8dda-12e423497061 service nova] Enqueued Resource ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 with Priority: HIGHEST for action security_group_rules [ 979.163742] env[70013]: INFO networking_nsxv3.common.synchronization [req-fdd2161a-597c-4591-b3fa-23d1cbc00384 req-e91e43ae-e600-4b1b-8dda-12e423497061 service nova] Enqueued Resource ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 with Priority: HIGHEST for action security_group_members [ 979.163974] env[70013]: INFO networking_nsxv3.common.synchronization [req-fdd2161a-597c-4591-b3fa-23d1cbc00384 req-e91e43ae-e600-4b1b-8dda-12e423497061 service nova] Enqueued Resource ID: a805f6e6-6016-433a-b106-0e686f4bd6ef with Priority: HIGHEST for action port [ 979.164221] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 with Priority: HIGHEST for action security_group_rules [ 979.164397] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 with Priority: HIGHEST for action security_group_members [ 979.164462] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a805f6e6-6016-433a-b106-0e686f4bd6ef with Priority: HIGHEST for action port [ 979.166011] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d0cfefe-0851-47aa-9a55-0d92164acbc1 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.166011] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.166011] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.166011] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.166011] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d0cfefe-0851-47aa-9a55-0d92164acbc1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.166844] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d0cfefe-0851-47aa-9a55-0d92164acbc1 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.166968] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.167034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.167214] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.167363] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.167457] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.167521] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.167662] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.167749] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.167852] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d0cfefe-0851-47aa-9a55-0d92164acbc1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.169226] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-a805f6e6-6016-433a-b106-0e686f4bd6ef taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.169366] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a805f6e6-6016-433a-b106-0e686f4bd6ef" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.169459] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a805f6e6-6016-433a-b106-0e686f4bd6ef" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.169641] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a805f6e6-6016-433a-b106-0e686f4bd6ef" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.169742] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a805f6e6-6016-433a-b106-0e686f4bd6ef',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.671071] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d0cfefe-0851-47aa-9a55-0d92164acbc1 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.672305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.672716] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d0cfefe-0851-47aa-9a55-0d92164acbc1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.677628] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a805f6e6-6016-433a-b106-0e686f4bd6ef with status ACTIVE [ 979.677628] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.677628] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.677628] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.677628] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.677628] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.677628] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.677628] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.677628] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.677628] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.677628] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.681138] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.681138] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.681138] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.681138] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.681138] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.681138] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a805f6e6-6016-433a-b106-0e686f4bd6ef is going to be updated. [ 979.701873] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.701873] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.701873] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.701873] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.701873] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.701873] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a805f6e6-6016-433a-b106-0e686f4bd6ef" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.177595] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d0cfefe-0851-47aa-9a55-0d92164acbc1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.681393] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.681726] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.681774] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.682115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.682289] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.682481] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 is going to be created. [ 980.706434] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.706644] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.706773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.707066] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.707304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.717679] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 in Status: UNINITIALIZED for 2s [ 980.718239] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33eb23fb-1e54-4510-ba50-bf9c982207a3 in Status: SUCCESS [ 980.718436] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.718587] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.718789] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.718967] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.719095] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.719154] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.719311] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.719405] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.719537] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.719583] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33eb23fb-1e54-4510-ba50-bf9c982207a3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.222554] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-33eb23fb-1e54-4510-ba50-bf9c982207a3 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.223906] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.223906] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.223906] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.223906] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.223906] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.223906] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.223906] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.223906] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.224454] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.224454] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-33eb23fb-1e54-4510-ba50-bf9c982207a3 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.224454] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.224454] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.224670] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.224804] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.225295] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.225295] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.225295] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.225525] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.225630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.225743] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33eb23fb-1e54-4510-ba50-bf9c982207a3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.729015] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33eb23fb-1e54-4510-ba50-bf9c982207a3: rpc.has_security_group_logging(os_id): False [ 981.750089] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.750258] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.750329] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.750556] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.750652] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.750871] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.750992] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.751076] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.751252] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.751333] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.751523] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.751633] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.751697] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.751841] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.751921] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.752143] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.752241] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.752301] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.752466] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.752503] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.752593] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33eb23fb-1e54-4510-ba50-bf9c982207a3 is going to be created. [ 981.805930] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.806138] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.806215] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.806440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.806630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.817656] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33eb23fb-1e54-4510-ba50-bf9c982207a3 in Status: IN_PROGRESS for 2s [ 982.374872] env[70013]: INFO networking_nsxv3.common.synchronization [req-d008617a-84d4-40a0-9126-35436a16c160 req-13a5c6da-c65b-4afa-b927-0b512d7c8e3e tempest-ListImageFiltersTestJSON-2117804784 tempest-ListImageFiltersTestJSON-2117804784-project-member] Enqueued Resource ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 with Priority: HIGHEST for action security_group_members [ 982.375188] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 with Priority: HIGHEST for action security_group_members [ 982.375510] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.375634] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.375702] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.375898] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.376719] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.376870] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.376944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.377135] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.377228] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.377326] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf5314a2-236c-4f4a-b8ea-d899149c1ea8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.384223] env[70013]: INFO networking_nsxv3.common.synchronization [req-b2d07f97-f941-4c9f-8cc3-23a87e39b759 req-76818566-b5c4-4d65-897b-a23003124fe8 tempest-ServerExternalEventsTest-408165301 tempest-ServerExternalEventsTest-408165301-project-member] Enqueued Resource ID: 9772853b-4ff5-4a28-8f4f-b2e864434ff9 with Priority: HIGHEST for action security_group_members [ 982.384767] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9772853b-4ff5-4a28-8f4f-b2e864434ff9 with Priority: HIGHEST for action security_group_members [ 982.385123] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9772853b-4ff5-4a28-8f4f-b2e864434ff9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.385296] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.385411] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.385641] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.385854] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.386026] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.387888] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.388114] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.388180] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.388265] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9772853b-4ff5-4a28-8f4f-b2e864434ff9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.714465] env[70013]: INFO networking_nsxv3.common.synchronization [req-4892a39f-3994-4751-97a9-f2e8e1f7d6fd req-165003f2-1453-48a1-a5f3-deb488289263 tempest-MigrationsAdminTest-81604366 tempest-MigrationsAdminTest-81604366-project-member] Enqueued Resource ID: 572a619a-3a59-46a6-bc09-5d754276356e with Priority: HIGHEST for action security_group_members [ 982.714979] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 572a619a-3a59-46a6-bc09-5d754276356e with Priority: HIGHEST for action security_group_members [ 982.715319] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-572a619a-3a59-46a6-bc09-5d754276356e taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.715516] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.715516] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.715723] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.715918] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.716308] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.716308] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.716308] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.716483] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.716483] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('572a619a-3a59-46a6-bc09-5d754276356e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.726804] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 in Status: SUCCESS [ 982.727055] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.727212] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.727424] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.727600] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.727721] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.727763] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.727910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.728804] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.728804] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.728804] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d0cfefe-0851-47aa-9a55-0d92164acbc1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.879458] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.879739] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.879739] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.879940] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.889792] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.889944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.899883] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.900194] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.900351] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.900443] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.900669] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.900787] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.900905] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 is going to be updated. [ 982.901876] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.902073] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.902160] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.902338] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.902439] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.902495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.902641] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.902719] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.902803] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9772853b-4ff5-4a28-8f4f-b2e864434ff9 is going to be updated. [ 982.927709] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.927826] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.927875] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.928960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.928960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.929976] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.930109] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.930195] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.930367] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.930484] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.938386] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9772853b-4ff5-4a28-8f4f-b2e864434ff9 in Status: IN_PROGRESS for 2s [ 982.938962] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 in Status: IN_PROGRESS for 2s [ 983.218647] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.218863] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.218963] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.219229] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.231084] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d0cfefe-0851-47aa-9a55-0d92164acbc1 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.231235] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.231294] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.231494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.231672] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.231761] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.231841] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.231973] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.232078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.232166] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.232310] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d0cfefe-0851-47aa-9a55-0d92164acbc1 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.232400] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.232456] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.232599] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.232733] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.232821] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.232878] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.233024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.233135] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.233170] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.233257] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d0cfefe-0851-47aa-9a55-0d92164acbc1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.241607] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.241607] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.241607] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.241607] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.241607] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.241607] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.241607] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 572a619a-3a59-46a6-bc09-5d754276356e is going to be updated. [ 983.265864] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.266067] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.266157] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.266448] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.266620] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.276211] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 572a619a-3a59-46a6-bc09-5d754276356e in Status: IN_PROGRESS for 2s [ 983.736012] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d0cfefe-0851-47aa-9a55-0d92164acbc1: rpc.has_security_group_logging(os_id): False [ 983.758059] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.758353] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.758433] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.758706] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.758843] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.759192] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.759331] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.759644] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.759754] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.759911] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.760449] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.760548] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.760593] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.760981] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.760981] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.761593] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.761593] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.761831] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.761831] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.761930] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.762060] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 is going to be created. [ 983.829415] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.829584] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.829658] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.829879] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.830110] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.841496] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33eb23fb-1e54-4510-ba50-bf9c982207a3 in Status: SUCCESS [ 983.841496] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.842052] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 in Status: IN_PROGRESS for 2s [ 984.093654] env[70013]: INFO networking_nsxv3.common.synchronization [req-060e6fb1-df52-4899-b811-6676d6208196 req-549c8570-48e9-4b70-bf01-a85da7903f71 tempest-DeleteServersTestJSON-1971284771 tempest-DeleteServersTestJSON-1971284771-project-member] Enqueued Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 984.094320] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 984.094663] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.094807] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.094943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.095203] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.095382] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.095490] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.095554] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.095717] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.095804] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.095899] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.723169] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.723169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.723169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.723169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.723169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.723169] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.723169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.723169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.723169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.723169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.723169] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b is going to be updated. [ 984.723169] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.723169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.723169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.723169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.723169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.725309] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: IN_PROGRESS for 2s [ 984.949716] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9772853b-4ff5-4a28-8f4f-b2e864434ff9 in Status: SUCCESS [ 984.949925] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9772853b-4ff5-4a28-8f4f-b2e864434ff9 deletion is rescheduled due to dependency. [ 984.950097] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.950869] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 in Status: SUCCESS [ 984.951029] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 deletion is rescheduled due to dependency. [ 984.951126] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.285349] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 572a619a-3a59-46a6-bc09-5d754276356e in Status: SUCCESS [ 985.285621] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 572a619a-3a59-46a6-bc09-5d754276356e deletion is rescheduled due to dependency. [ 985.285666] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.854064] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 in Status: SUCCESS [ 985.854185] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.649363] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: SUCCESS [ 986.649735] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b deletion is rescheduled due to dependency. [ 986.649735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.095572] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 989.095849] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 993.893645] env[70013]: INFO networking_nsxv3.common.synchronization [req-942f7918-0499-4426-8c27-ae1ffdafc531 req-1f2062c6-92ba-4caa-a7c9-ba31f61a5ad7 tempest-FloatingIPsAssociationNegativeTestJSON-925045144 tempest-FloatingIPsAssociationNegativeTestJSON-925045144-project-member] Enqueued Resource ID: 33eb23fb-1e54-4510-ba50-bf9c982207a3 with Priority: HIGHEST for action security_group_members [ 993.894282] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33eb23fb-1e54-4510-ba50-bf9c982207a3 with Priority: HIGHEST for action security_group_members [ 993.894631] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-33eb23fb-1e54-4510-ba50-bf9c982207a3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.894778] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.894853] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.895081] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.895260] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.895367] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.895442] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.895606] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.895697] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.895776] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33eb23fb-1e54-4510-ba50-bf9c982207a3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.400424] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.401015] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.401015] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.401015] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.401015] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.401280] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.401280] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.401422] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.401493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.401571] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.401657] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33eb23fb-1e54-4510-ba50-bf9c982207a3 is going to be updated. [ 994.444635] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.444779] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.444836] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.445056] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.445197] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.454157] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33eb23fb-1e54-4510-ba50-bf9c982207a3 in Status: IN_PROGRESS for 2s [ 995.830199] env[70013]: INFO networking_nsxv3.common.synchronization [req-f736da04-0083-4d76-8f10-820dc62cbe19 req-5f36fbcc-4459-4f10-85c3-29004ea39979 tempest-ListServerFiltersTestJSON-1686378133 tempest-ListServerFiltersTestJSON-1686378133-project-member] Enqueued Resource ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 with Priority: HIGHEST for action security_group_members [ 995.830199] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 with Priority: HIGHEST for action security_group_members [ 995.830199] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb27dbe1-6f26-411f-bcfc-69daca38eb24 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.831735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.831958] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.832429] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.832713] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.833492] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.833492] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.833492] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.833492] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.833817] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.867930] env[70013]: INFO networking_nsxv3.common.synchronization [None req-d418522c-42dd-4e0c-94f5-6a46ed14700e None None] Enqueued Resource ID: cf92181e-8780-49ff-b2a4-d3e276d3ae79 with Priority: HIGHEST for action port [ 995.868448] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf92181e-8780-49ff-b2a4-d3e276d3ae79 with Priority: HIGHEST for action port [ 995.869177] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf92181e-8780-49ff-b2a4-d3e276d3ae79 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.869475] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf92181e-8780-49ff-b2a4-d3e276d3ae79" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.869475] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf92181e-8780-49ff-b2a4-d3e276d3ae79" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.869958] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf92181e-8780-49ff-b2a4-d3e276d3ae79" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.869958] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf92181e-8780-49ff-b2a4-d3e276d3ae79',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.336864] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.372656] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf92181e-8780-49ff-b2a4-d3e276d3ae79 [ 996.372656] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.372656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.372656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.372656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.372656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.372656] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf92181e-8780-49ff-b2a4-d3e276d3ae79 already deleted. [ 996.372656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf92181e-8780-49ff-b2a4-d3e276d3ae79" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.467281] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33eb23fb-1e54-4510-ba50-bf9c982207a3 in Status: SUCCESS [ 996.467508] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33eb23fb-1e54-4510-ba50-bf9c982207a3 deletion is rescheduled due to dependency. [ 996.467622] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.840558] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.343178] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.343364] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.343414] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.343623] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.343716] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.343818] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 is going to be updated. [ 997.372970] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.373187] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.373187] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.374070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.374070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.384516] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 in Status: IN_PROGRESS for 2s [ 998.086854] env[70013]: INFO networking_nsxv3.common.synchronization [None req-b54887c3-17b1-4bbc-b121-b989255ab834 None None] Enqueued Resource ID: 78558f6b-1e56-46e1-b42b-fbbadeb15f53 with Priority: HIGHEST for action port [ 998.087609] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78558f6b-1e56-46e1-b42b-fbbadeb15f53 with Priority: HIGHEST for action port [ 998.087745] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-78558f6b-1e56-46e1-b42b-fbbadeb15f53 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.087864] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78558f6b-1e56-46e1-b42b-fbbadeb15f53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.087930] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78558f6b-1e56-46e1-b42b-fbbadeb15f53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.088207] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78558f6b-1e56-46e1-b42b-fbbadeb15f53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.088588] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78558f6b-1e56-46e1-b42b-fbbadeb15f53',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.590490] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 78558f6b-1e56-46e1-b42b-fbbadeb15f53 [ 998.590767] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.590900] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.590968] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.591190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.591285] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.591389] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:78558f6b-1e56-46e1-b42b-fbbadeb15f53 already deleted. [ 998.591460] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78558f6b-1e56-46e1-b42b-fbbadeb15f53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.396795] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 in Status: SUCCESS [ 999.397084] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.154181] env[70013]: INFO networking_nsxv3.common.synchronization [None req-9d7e04e8-0cc5-4446-b5b8-e979c30cb8c4 None None] Enqueued Resource ID: 6a11758b-d620-4fb7-96c2-0a7db24413a5 with Priority: HIGHEST for action port [ 1001.154781] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a11758b-d620-4fb7-96c2-0a7db24413a5 with Priority: HIGHEST for action port [ 1001.155232] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a11758b-d620-4fb7-96c2-0a7db24413a5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.155391] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a11758b-d620-4fb7-96c2-0a7db24413a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.155483] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a11758b-d620-4fb7-96c2-0a7db24413a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.155846] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a11758b-d620-4fb7-96c2-0a7db24413a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.155941] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a11758b-d620-4fb7-96c2-0a7db24413a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.659296] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a11758b-d620-4fb7-96c2-0a7db24413a5 [ 1001.659455] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.659586] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.659653] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.659864] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.661154] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.661154] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a11758b-d620-4fb7-96c2-0a7db24413a5 already deleted. [ 1001.661154] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a11758b-d620-4fb7-96c2-0a7db24413a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.255287] env[70013]: INFO networking_nsxv3.common.synchronization [None req-8b0fe834-0171-4e3d-a20f-c1d36361fe29 None None] Enqueued Resource ID: 54f4eab7-dcc5-4535-ab89-0a4fc0a1e4b4 with Priority: HIGHEST for action port [ 1003.259021] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54f4eab7-dcc5-4535-ab89-0a4fc0a1e4b4 with Priority: HIGHEST for action port [ 1003.259021] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-54f4eab7-dcc5-4535-ab89-0a4fc0a1e4b4 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.259021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54f4eab7-dcc5-4535-ab89-0a4fc0a1e4b4" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.259021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54f4eab7-dcc5-4535-ab89-0a4fc0a1e4b4" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.259021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54f4eab7-dcc5-4535-ab89-0a4fc0a1e4b4" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.259021] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54f4eab7-dcc5-4535-ab89-0a4fc0a1e4b4',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.597838] env[70013]: INFO networking_nsxv3.common.synchronization [req-9baf59d0-3ba2-42b1-a4e7-f10a5f016d33 req-83e03840-be3b-4032-9f7a-9e4c37c6958a tempest-ImagesTestJSON-851757871 tempest-ImagesTestJSON-851757871-project-member] Enqueued Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 1003.598685] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 1003.598685] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.598900] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.598900] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.599090] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.599179] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.599395] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.599395] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.599553] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.599553] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.599650] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.758501] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 54f4eab7-dcc5-4535-ab89-0a4fc0a1e4b4 [ 1003.759984] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.760829] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.760923] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.761285] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.761347] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.761606] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:54f4eab7-dcc5-4535-ab89-0a4fc0a1e4b4 already deleted. [ 1003.761740] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54f4eab7-dcc5-4535-ab89-0a4fc0a1e4b4" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.880157] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-875 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.880375] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-875" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.880506] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-875" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.880801] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-875" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.881079] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.881281] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.881409] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.881634] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.881996] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.882325] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1003.882572] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1003.882803] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1003.882999] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1003.883184] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1003.883331] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1003.883512] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1003.902910] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1003.903026] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1003.903137] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1003.903363] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-875" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.903937] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-06d51c44-f553-4e0b-9d14-0c9f56972fee taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.903937] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-06d51c44-f553-4e0b-9d14-0c9f56972fee" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.904145] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-06d51c44-f553-4e0b-9d14-0c9f56972fee" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.904363] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-06d51c44-f553-4e0b-9d14-0c9f56972fee" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.904510] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06d51c44-f553-4e0b-9d14-0c9f56972fee',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.102037] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.102212] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.102291] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.102505] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.102599] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.102798] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.102897] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.102958] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.103120] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.103198] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.103288] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 is going to be updated. [ 1004.129172] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.129322] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.129421] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.129607] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.129746] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.138303] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: IN_PROGRESS for 2s [ 1004.406962] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.407307] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.407370] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.407849] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.407849] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.407959] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 06d51c44-f553-4e0b-9d14-0c9f56972fee not found, creating... [ 1004.408230] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.408390] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.408511] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.408765] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.408911] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.409216] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.409401] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.409498] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.409707] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.409845] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.409994] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 06d51c44-f553-4e0b-9d14-0c9f56972fee is going to be created. [ 1004.428753] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.428944] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.429057] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.429290] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.429511] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.429758] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-06d51c44-f553-4e0b-9d14-0c9f56972fee" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.912040] env[70013]: INFO networking_nsxv3.common.synchronization [req-5ee4af63-d055-43c9-8388-9b514e2ab591 req-748debfa-427a-411d-951e-e7b4fd887738 tempest-ServerActionsTestOtherA-108106573 tempest-ServerActionsTestOtherA-108106573-project-member] Enqueued Resource ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 with Priority: HIGHEST for action security_group_members [ 1004.912676] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 with Priority: HIGHEST for action security_group_members [ 1004.913039] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d0cfefe-0851-47aa-9a55-0d92164acbc1 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.913190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.913266] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.913710] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.913710] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.913710] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.913903] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.913937] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.914022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.914116] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d0cfefe-0851-47aa-9a55-0d92164acbc1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.141784] env[70013]: INFO networking_nsxv3.common.synchronization [req-9baf59d0-3ba2-42b1-a4e7-f10a5f016d33 req-786b3b2d-d467-4587-8191-7fcc9c9007e3 service nova] Enqueued Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_rules [ 1005.141966] env[70013]: INFO networking_nsxv3.common.synchronization [req-9baf59d0-3ba2-42b1-a4e7-f10a5f016d33 req-786b3b2d-d467-4587-8191-7fcc9c9007e3 service nova] Enqueued Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 1005.142129] env[70013]: INFO networking_nsxv3.common.synchronization [req-9baf59d0-3ba2-42b1-a4e7-f10a5f016d33 req-786b3b2d-d467-4587-8191-7fcc9c9007e3 service nova] Enqueued Resource ID: 06d51c44-f553-4e0b-9d14-0c9f56972fee with Priority: HIGHEST for action port [ 1005.142628] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_rules [ 1005.142763] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 1005.142869] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d51c44-f553-4e0b-9d14-0c9f56972fee with Priority: HIGHEST for action port [ 1005.145664] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.145803] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.145871] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.146102] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.146192] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.147999] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.148119] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.148320] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-06d51c44-f553-4e0b-9d14-0c9f56972fee taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.148427] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06d51c44-f553-4e0b-9d14-0c9f56972fee" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.148494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06d51c44-f553-4e0b-9d14-0c9f56972fee" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.148673] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06d51c44-f553-4e0b-9d14-0c9f56972fee" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.148750] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06d51c44-f553-4e0b-9d14-0c9f56972fee',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.416839] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.417126] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.417126] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.417202] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.417875] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.417875] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.417875] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.417875] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.417875] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.417875] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.418224] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 is going to be updated. [ 1005.446965] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.446965] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.446965] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.446965] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.446965] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.454421] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 in Status: IN_PROGRESS for 2s [ 1005.650509] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.650668] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.650849] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 06d51c44-f553-4e0b-9d14-0c9f56972fee with status ACTIVE [ 1005.651030] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.651151] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.651227] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.651589] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.651589] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.651708] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.651784] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.651835] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.651993] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.652099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.652361] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.652451] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.652510] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.652653] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.652728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.652811] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 06d51c44-f553-4e0b-9d14-0c9f56972fee is going to be updated. [ 1005.674523] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.674523] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.674523] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.674745] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.674847] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.675010] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06d51c44-f553-4e0b-9d14-0c9f56972fee" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.149380] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: IN_PROGRESS for 4s [ 1007.464019] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 in Status: SUCCESS [ 1007.464352] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 deletion is rescheduled due to dependency. [ 1007.464409] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.926803] env[70013]: INFO networking_nsxv3.common.synchronization [req-0d8d801a-d823-41e6-862c-54ddf5d84421 req-3191ac17-239e-447d-ad3c-cc3ef8a5633e tempest-AttachInterfacesUnderV243Test-760224301 tempest-AttachInterfacesUnderV243Test-760224301-project-member] Enqueued Resource ID: bb3e5499-be65-479e-916c-2fb08083e417 with Priority: HIGHEST for action security_group_members [ 1007.927357] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb3e5499-be65-479e-916c-2fb08083e417 with Priority: HIGHEST for action security_group_members [ 1007.927666] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb3e5499-be65-479e-916c-2fb08083e417 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.927786] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.928046] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.928528] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.928752] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.928878] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.928923] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.929096] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.929185] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.929279] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb3e5499-be65-479e-916c-2fb08083e417',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.159237] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: SUCCESS [ 1008.159405] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 deletion is rescheduled due to dependency. [ 1008.159450] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.159668] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.159860] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.162858] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.162858] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.162858] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.162858] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.162858] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.162858] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.206027] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-869 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.206027] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-869" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.206027] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-869" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.206244] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-869" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.206338] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.206632] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.207160] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.207160] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.208512] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.208512] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1008.208512] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1008.208512] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1008.208512] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1008.208512] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1008.208512] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1008.208512] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1008.225270] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1008.225270] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1008.225507] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1008.225571] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-869" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.226900] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-92b2e42f-1b28-4c86-a59d-e06f2adc11da taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.226900] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-92b2e42f-1b28-4c86-a59d-e06f2adc11da" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.226900] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-92b2e42f-1b28-4c86-a59d-e06f2adc11da" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.226900] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-92b2e42f-1b28-4c86-a59d-e06f2adc11da" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.227118] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92b2e42f-1b28-4c86-a59d-e06f2adc11da',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.431371] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.431544] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.431626] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.431832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.431927] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.432143] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.432324] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.432387] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.432546] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.432657] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.432736] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb3e5499-be65-479e-916c-2fb08083e417 already deleted. [ 1008.432789] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.664083] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.730280] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.731096] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.731096] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.731096] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.731096] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.731276] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 92b2e42f-1b28-4c86-a59d-e06f2adc11da not found, creating... [ 1008.731456] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.733036] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.733036] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.733036] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.733036] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.733036] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.733036] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.733036] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.733036] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.733036] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.733420] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 92b2e42f-1b28-4c86-a59d-e06f2adc11da is going to be created. [ 1008.755235] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.755458] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.755587] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.755868] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.756131] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.756351] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-92b2e42f-1b28-4c86-a59d-e06f2adc11da" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.170784] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.488261] env[70013]: INFO networking_nsxv3.common.synchronization [req-0d8d801a-d823-41e6-862c-54ddf5d84421 req-58a66044-2c7d-400b-b26b-242e4f1e543f service nova] Enqueued Resource ID: bb3e5499-be65-479e-916c-2fb08083e417 with Priority: HIGHEST for action security_group_rules [ 1009.488470] env[70013]: INFO networking_nsxv3.common.synchronization [req-0d8d801a-d823-41e6-862c-54ddf5d84421 req-58a66044-2c7d-400b-b26b-242e4f1e543f service nova] Enqueued Resource ID: bb3e5499-be65-479e-916c-2fb08083e417 with Priority: HIGHEST for action security_group_members [ 1009.488590] env[70013]: INFO networking_nsxv3.common.synchronization [req-0d8d801a-d823-41e6-862c-54ddf5d84421 req-58a66044-2c7d-400b-b26b-242e4f1e543f service nova] Enqueued Resource ID: 92b2e42f-1b28-4c86-a59d-e06f2adc11da with Priority: HIGHEST for action port [ 1009.489191] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb3e5499-be65-479e-916c-2fb08083e417 with Priority: HIGHEST for action security_group_rules [ 1009.489330] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb3e5499-be65-479e-916c-2fb08083e417 with Priority: HIGHEST for action security_group_members [ 1009.489429] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92b2e42f-1b28-4c86-a59d-e06f2adc11da with Priority: HIGHEST for action port [ 1009.489698] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb3e5499-be65-479e-916c-2fb08083e417 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.489820] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.489890] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.490098] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.490178] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb3e5499-be65-479e-916c-2fb08083e417',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.491032] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb3e5499-be65-479e-916c-2fb08083e417 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.491147] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.491199] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.491416] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.491500] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.491595] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.491658] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.491799] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.491881] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.491971] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb3e5499-be65-479e-916c-2fb08083e417',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.492727] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-92b2e42f-1b28-4c86-a59d-e06f2adc11da taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.492832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92b2e42f-1b28-4c86-a59d-e06f2adc11da" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.492895] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92b2e42f-1b28-4c86-a59d-e06f2adc11da" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.493063] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92b2e42f-1b28-4c86-a59d-e06f2adc11da" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.493139] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92b2e42f-1b28-4c86-a59d-e06f2adc11da',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.673205] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.673487] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.673487] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.673656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.673750] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.673854] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 is going to be updated. [ 1009.708980] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.709115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.709193] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.709406] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.709556] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.717130] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: IN_PROGRESS for 2s [ 1009.995873] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb3e5499-be65-479e-916c-2fb08083e417 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.996012] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.996225] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb3e5499-be65-479e-916c-2fb08083e417',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.998623] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 92b2e42f-1b28-4c86-a59d-e06f2adc11da with status ACTIVE [ 1009.998623] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.998623] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.998623] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.998623] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.998850] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.998850] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.998981] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.998981] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.999958] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.999958] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.999958] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.999958] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.999958] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.999958] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.999958] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.999958] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 92b2e42f-1b28-4c86-a59d-e06f2adc11da is going to be updated. [ 1010.018938] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.019090] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.019090] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.019268] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.019407] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.019632] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92b2e42f-1b28-4c86-a59d-e06f2adc11da" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.499146] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb3e5499-be65-479e-916c-2fb08083e417',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.005035] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.005035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.005035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.005035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.005035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.005035] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb3e5499-be65-479e-916c-2fb08083e417 is going to be created. [ 1011.024109] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.024529] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.024611] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.024826] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.024987] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.033048] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb3e5499-be65-479e-916c-2fb08083e417 in Status: UNINITIALIZED for 2s [ 1011.036145] env[70013]: INFO networking_nsxv3.common.synchronization [req-c88234d3-f5e6-437a-82bc-2a153915e881 req-7bd7d264-661e-4c6e-86a7-def91c5182d1 tempest-AttachVolumeNegativeTest-680083968 tempest-AttachVolumeNegativeTest-680083968-project-member] Enqueued Resource ID: 0e60d03d-8d54-4827-87a6-1c1728f166fe with Priority: HIGHEST for action security_group_members [ 1011.037048] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e60d03d-8d54-4827-87a6-1c1728f166fe with Priority: HIGHEST for action security_group_members [ 1011.037377] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e60d03d-8d54-4827-87a6-1c1728f166fe taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.037496] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.037566] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.037760] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.038638] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.038638] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.038638] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.038638] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.038834] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.038834] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e60d03d-8d54-4827-87a6-1c1728f166fe',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.541442] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.541442] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.541615] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.541792] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.541857] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.542062] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.542185] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.542318] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.542481] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.542561] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.542652] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e60d03d-8d54-4827-87a6-1c1728f166fe is going to be updated. [ 1011.567530] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.567667] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.567739] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.567934] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.568088] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.575646] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e60d03d-8d54-4827-87a6-1c1728f166fe in Status: IN_PROGRESS for 2s [ 1011.727039] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: SUCCESS [ 1011.727290] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.727476] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.727714] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.727928] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.728082] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.728159] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.728357] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.728447] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.728544] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.728654] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.231448] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.231730] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.231730] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.231876] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.232048] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.232150] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.232205] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.232355] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.232444] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.232531] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.232675] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.232766] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.232825] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.233075] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.233220] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.233318] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.233381] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.233524] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.233599] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.233681] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.233768] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.736272] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc1b714b-7da7-41dc-b21f-d8ad167c33d9: rpc.has_security_group_logging(os_id): False [ 1012.752800] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.753031] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.753031] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.753400] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.753400] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.753541] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.753630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.753682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.753832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.753906] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.754098] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.754197] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.754296] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.754453] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.754541] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.754704] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.754791] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.754974] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.754974] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.755094] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.755142] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 is going to be updated. [ 1012.809863] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.809993] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.810056] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.810287] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.810439] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.823662] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: IN_PROGRESS for 2s [ 1013.042398] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb3e5499-be65-479e-916c-2fb08083e417 in Status: SUCCESS [ 1013.042653] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.042832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.043091] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.044024] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.044024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.044024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.044024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.044024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.044024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.044024] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bb3e5499-be65-479e-916c-2fb08083e417',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.547459] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bb3e5499-be65-479e-916c-2fb08083e417',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.585343] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e60d03d-8d54-4827-87a6-1c1728f166fe in Status: SUCCESS [ 1013.585473] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e60d03d-8d54-4827-87a6-1c1728f166fe deletion is rescheduled due to dependency. [ 1013.585630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.053815] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bb3e5499-be65-479e-916c-2fb08083e417: rpc.has_security_group_logging(os_id): False [ 1014.072161] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.072340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.072417] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.072631] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.072724] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.072966] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.073286] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.073378] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.073525] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.073627] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.073726] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb3e5499-be65-479e-916c-2fb08083e417 is going to be created. [ 1014.126524] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.126684] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.126769] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.127029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.127233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.136955] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb3e5499-be65-479e-916c-2fb08083e417 in Status: IN_PROGRESS for 2s [ 1014.839171] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: SUCCESS [ 1014.839171] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.038031] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1016.038031] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1016.148266] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb3e5499-be65-479e-916c-2fb08083e417 in Status: SUCCESS [ 1016.148502] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.370048] env[70013]: INFO networking_nsxv3.common.synchronization [req-784e6cd5-ab87-4835-ad76-fa0be54c2875 req-f5e5515f-c87c-4c6e-941e-9c9ab5fa7bdf tempest-ServerRescueTestJSON-1890363448 tempest-ServerRescueTestJSON-1890363448-project-member] Enqueued Resource ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 with Priority: HIGHEST for action security_group_members [ 1017.370660] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 with Priority: HIGHEST for action security_group_members [ 1017.370978] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6998667-5e88-456a-b064-7faf8fc4bfd8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.371119] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.371183] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.371391] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.371544] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.371646] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.371709] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.371861] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.371944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.372767] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6998667-5e88-456a-b064-7faf8fc4bfd8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.738760] env[70013]: INFO networking_nsxv3.common.synchronization [None req-7575193a-b04d-4941-8848-27a4843c0bd9 None None] Enqueued Resource ID: 1cd38418-8c67-4101-a715-511b3ff996f5 with Priority: HIGHEST for action port [ 1017.740487] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cd38418-8c67-4101-a715-511b3ff996f5 with Priority: HIGHEST for action port [ 1017.740487] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-1cd38418-8c67-4101-a715-511b3ff996f5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.740487] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1cd38418-8c67-4101-a715-511b3ff996f5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.740487] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1cd38418-8c67-4101-a715-511b3ff996f5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.744181] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1cd38418-8c67-4101-a715-511b3ff996f5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.744181] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1cd38418-8c67-4101-a715-511b3ff996f5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.875199] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6998667-5e88-456a-b064-7faf8fc4bfd8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.886033] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-782 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.886993] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-782" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.886993] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-782" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.886993] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-782" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.888992] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.888992] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.888992] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.888992] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.888992] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.888992] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1017.888992] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1017.889355] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1017.889355] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1017.889355] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1017.889580] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1017.889666] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1017.931290] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1017.931481] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.042 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1017.931628] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1017.931834] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-782" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.932241] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-02386321-e9cb-45ce-b235-d3c121d3cff1 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.932386] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-02386321-e9cb-45ce-b235-d3c121d3cff1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.932593] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-02386321-e9cb-45ce-b235-d3c121d3cff1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.932942] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-02386321-e9cb-45ce-b235-d3c121d3cff1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.933158] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02386321-e9cb-45ce-b235-d3c121d3cff1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.246757] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1cd38418-8c67-4101-a715-511b3ff996f5 [ 1018.246757] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.246905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.248621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.248621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.248621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.248621] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1cd38418-8c67-4101-a715-511b3ff996f5 already deleted. [ 1018.248621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1cd38418-8c67-4101-a715-511b3ff996f5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.381258] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6998667-5e88-456a-b064-7faf8fc4bfd8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.435610] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.435876] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.436736] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.436736] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.436859] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.437022] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 02386321-e9cb-45ce-b235-d3c121d3cff1 not found, creating... [ 1018.437333] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.437511] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.437635] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.437878] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.438037] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.438355] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.438522] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.438651] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.438867] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.439027] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.439176] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 02386321-e9cb-45ce-b235-d3c121d3cff1 is going to be created. [ 1018.458790] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.459164] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.459342] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.459718] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.460035] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.460386] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-02386321-e9cb-45ce-b235-d3c121d3cff1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.885028] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.885028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.885365] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.885365] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.885365] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.885572] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 is going to be updated. [ 1018.913838] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.914066] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.915103] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.915103] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.915188] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.925620] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 in Status: IN_PROGRESS for 2s [ 1019.157881] env[70013]: INFO networking_nsxv3.common.synchronization [req-784e6cd5-ab87-4835-ad76-fa0be54c2875 req-6496c07e-6476-47e7-b4a6-d2d7f76f6fa0 service nova] Enqueued Resource ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 with Priority: HIGHEST for action security_group_rules [ 1019.158082] env[70013]: INFO networking_nsxv3.common.synchronization [req-784e6cd5-ab87-4835-ad76-fa0be54c2875 req-6496c07e-6476-47e7-b4a6-d2d7f76f6fa0 service nova] Enqueued Resource ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 with Priority: HIGHEST for action security_group_members [ 1019.158235] env[70013]: INFO networking_nsxv3.common.synchronization [req-784e6cd5-ab87-4835-ad76-fa0be54c2875 req-6496c07e-6476-47e7-b4a6-d2d7f76f6fa0 service nova] Enqueued Resource ID: 02386321-e9cb-45ce-b235-d3c121d3cff1 with Priority: HIGHEST for action port [ 1019.158736] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 with Priority: HIGHEST for action security_group_rules [ 1019.158930] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 with Priority: HIGHEST for action security_group_members [ 1019.158966] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02386321-e9cb-45ce-b235-d3c121d3cff1 with Priority: HIGHEST for action port [ 1019.159830] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f6998667-5e88-456a-b064-7faf8fc4bfd8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.160082] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.162759] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.162759] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.162759] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f6998667-5e88-456a-b064-7faf8fc4bfd8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.162759] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6998667-5e88-456a-b064-7faf8fc4bfd8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.162759] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.162759] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-02386321-e9cb-45ce-b235-d3c121d3cff1 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.162759] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02386321-e9cb-45ce-b235-d3c121d3cff1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.162759] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02386321-e9cb-45ce-b235-d3c121d3cff1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.162759] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02386321-e9cb-45ce-b235-d3c121d3cff1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.163148] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02386321-e9cb-45ce-b235-d3c121d3cff1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.460143] env[70013]: INFO networking_nsxv3.common.synchronization [req-2f59e5b5-96fb-40a3-95e2-5109883c01e7 req-29fb04ba-f06b-4c1d-81b4-64471314f169 tempest-DeleteServersTestJSON-1971284771 tempest-DeleteServersTestJSON-1971284771-project-member] Enqueued Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 1019.460143] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 1019.460143] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.460143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.460143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.460901] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.461341] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.462659] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.462659] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.462738] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.462767] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.462886] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.666868] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6998667-5e88-456a-b064-7faf8fc4bfd8 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.666980] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.667169] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 02386321-e9cb-45ce-b235-d3c121d3cff1 with status ACTIVE [ 1019.667342] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.667449] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.667519] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.667754] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.667814] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.667988] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.668095] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.668159] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.668418] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.668418] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.668583] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.668683] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.668753] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.668894] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.668969] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.669099] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 02386321-e9cb-45ce-b235-d3c121d3cff1 is going to be updated. [ 1019.689386] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.689541] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.689595] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.689800] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.689931] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.690102] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02386321-e9cb-45ce-b235-d3c121d3cff1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.748377] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-446 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.748578] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-446" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.748709] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-446" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.748984] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-446" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.749261] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.749426] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.749549] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.749777] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.749930] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.752349] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1019.752484] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1019.752609] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1019.752727] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1019.752854] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1019.753096] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1019.753160] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1019.778335] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1019.778517] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1019.778658] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1019.778837] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-446" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.779188] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-f3bb6c02-a473-447c-a316-a09dfd62af88 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.779366] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-f3bb6c02-a473-447c-a316-a09dfd62af88" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.779514] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-f3bb6c02-a473-447c-a316-a09dfd62af88" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.779873] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-f3bb6c02-a473-447c-a316-a09dfd62af88" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.780057] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3bb6c02-a473-447c-a316-a09dfd62af88',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.896825] env[70013]: INFO networking_nsxv3.common.synchronization [None req-9f8c00d3-2225-4dd3-879f-cceec6b44b57 None None] Enqueued Resource ID: 11311368-8ddc-4616-aed8-a9977dae4a07 with Priority: HIGHEST for action port [ 1019.897113] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11311368-8ddc-4616-aed8-a9977dae4a07 with Priority: HIGHEST for action port [ 1019.897686] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-11311368-8ddc-4616-aed8-a9977dae4a07 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.898015] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11311368-8ddc-4616-aed8-a9977dae4a07" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.898095] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11311368-8ddc-4616-aed8-a9977dae4a07" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.898515] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11311368-8ddc-4616-aed8-a9977dae4a07" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.898515] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11311368-8ddc-4616-aed8-a9977dae4a07',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.965086] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.969593] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.969593] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.969888] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.969888] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.969986] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.970113] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.970215] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.970430] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.970521] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.970640] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b is going to be updated. [ 1020.004023] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.004023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.004023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.004023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.004023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.013706] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: IN_PROGRESS for 2s [ 1020.286795] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.287014] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.287533] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.287533] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.287533] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.287678] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port f3bb6c02-a473-447c-a316-a09dfd62af88 not found, creating... [ 1020.287946] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.288119] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.288230] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.288463] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.288605] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.288929] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.289124] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.289250] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.289486] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.289646] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.289793] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: f3bb6c02-a473-447c-a316-a09dfd62af88 is going to be created. [ 1020.311293] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.311473] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.311601] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.311918] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.312179] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.312410] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-f3bb6c02-a473-447c-a316-a09dfd62af88" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.402379] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 11311368-8ddc-4616-aed8-a9977dae4a07 [ 1020.402379] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.402523] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.402708] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.402800] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.402915] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.403031] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:11311368-8ddc-4616-aed8-a9977dae4a07 already deleted. [ 1020.403165] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11311368-8ddc-4616-aed8-a9977dae4a07" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.935734] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 in Status: SUCCESS [ 1020.936078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.936239] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.936479] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.936718] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.936868] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.936954] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.937224] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.937320] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.937480] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6998667-5e88-456a-b064-7faf8fc4bfd8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.029424] env[70013]: INFO networking_nsxv3.common.synchronization [req-2f59e5b5-96fb-40a3-95e2-5109883c01e7 req-77c2ae78-6d4d-4f7e-b366-dfbac47deb8f service nova] Enqueued Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_rules [ 1021.029424] env[70013]: INFO networking_nsxv3.common.synchronization [req-2f59e5b5-96fb-40a3-95e2-5109883c01e7 req-77c2ae78-6d4d-4f7e-b366-dfbac47deb8f service nova] Enqueued Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 1021.029424] env[70013]: INFO networking_nsxv3.common.synchronization [req-2f59e5b5-96fb-40a3-95e2-5109883c01e7 req-77c2ae78-6d4d-4f7e-b366-dfbac47deb8f service nova] Enqueued Resource ID: f3bb6c02-a473-447c-a316-a09dfd62af88 with Priority: HIGHEST for action port [ 1021.029588] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_rules [ 1021.029755] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 1021.029808] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3bb6c02-a473-447c-a316-a09dfd62af88 with Priority: HIGHEST for action port [ 1021.030413] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.030512] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.030566] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.030718] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.030801] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.031655] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.031755] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.035131] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3bb6c02-a473-447c-a316-a09dfd62af88 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.035131] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3bb6c02-a473-447c-a316-a09dfd62af88" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.035131] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3bb6c02-a473-447c-a316-a09dfd62af88" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.035131] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3bb6c02-a473-447c-a316-a09dfd62af88" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.035131] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3bb6c02-a473-447c-a316-a09dfd62af88',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.439522] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6998667-5e88-456a-b064-7faf8fc4bfd8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.533803] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.533939] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.534480] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3bb6c02-a473-447c-a316-a09dfd62af88 with status ACTIVE [ 1021.534480] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.534480] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.534713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.534770] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.534898] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.535910] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.535910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.535910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.535910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.535910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.535910] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.535910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.535910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.535910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.535910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.536763] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3bb6c02-a473-447c-a316-a09dfd62af88 is going to be updated. [ 1021.555128] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.555128] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.555128] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.555279] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.555279] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.555441] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3bb6c02-a473-447c-a316-a09dfd62af88" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.823259] env[70013]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1021.823517] env[70013]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] NSXv3 Agent Agent loop - iteration:2 started [ 1021.942503] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6998667-5e88-456a-b064-7faf8fc4bfd8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.020632] env[70013]: INFO networking_nsxv3.common.synchronization [req-2426b0f8-dc96-48a5-98aa-7060541b5428 req-b14558cc-8a62-43e7-bd93-cb8e8dcf9fec tempest-ServerActionsTestJSON-1661939768 tempest-ServerActionsTestJSON-1661939768-project-member] Enqueued Resource ID: 0776053c-3635-4232-86b2-1a586b64e542 with Priority: HIGHEST for action security_group_members [ 1022.021593] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0776053c-3635-4232-86b2-1a586b64e542 with Priority: HIGHEST for action security_group_members [ 1022.021740] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0776053c-3635-4232-86b2-1a586b64e542 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.021845] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.021914] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.022144] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.022658] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.022751] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.022821] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.022985] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.023103] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.023203] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0776053c-3635-4232-86b2-1a586b64e542',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.024697] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: SUCCESS [ 1022.024857] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b deletion is rescheduled due to dependency. [ 1022.024956] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.025391] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.025574] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.025947] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.025947] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.025947] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.026162] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.026162] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.026318] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.028454] env[70013]: INFO networking_nsxv3.common.synchronization [req-11ad4b5a-7894-48b6-959d-7fe30ab59c46 req-6bd1e50b-830f-4513-a4c2-48982aea9c7f tempest-ServersTestJSON-1543902807 tempest-ServersTestJSON-1543902807-project-member] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 1022.028882] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 1022.029317] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.029427] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.029492] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.029652] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.029862] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.030043] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.030043] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.030182] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.030259] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.030688] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.421599] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-250 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.421599] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-250" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.421599] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-250" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.421822] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-250" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.422100] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.422268] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.422410] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.422652] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.422811] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.424303] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1022.424569] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1022.424729] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1022.424879] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1022.425039] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1022.425261] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1022.425474] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1022.443960] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1022.444077] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1022.444209] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1022.444416] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-250" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.444743] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-d9bd6893-0205-4ae9-9f12-07dbc827824e taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.444921] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-d9bd6893-0205-4ae9-9f12-07dbc827824e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.445057] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-d9bd6893-0205-4ae9-9f12-07dbc827824e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.445380] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-d9bd6893-0205-4ae9-9f12-07dbc827824e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.445537] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9bd6893-0205-4ae9-9f12-07dbc827824e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.449428] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.449537] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.449662] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.449770] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.449853] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.449945] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 is going to be updated. [ 1022.477703] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.477865] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.477925] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.478121] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.478253] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.487566] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 in Status: IN_PROGRESS for 2s [ 1022.528017] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.528242] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.528242] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.528485] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.528585] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.528782] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.528883] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.528946] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.529123] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.529200] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.529287] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0776053c-3635-4232-86b2-1a586b64e542 is going to be updated. [ 1022.530319] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.533056] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.554822] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.554998] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.555070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.555245] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.555514] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.563394] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0776053c-3635-4232-86b2-1a586b64e542 in Status: IN_PROGRESS for 2s [ 1022.954216] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.954587] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.954700] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.954997] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.955185] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.955387] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port d9bd6893-0205-4ae9-9f12-07dbc827824e not found, creating... [ 1022.955721] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.955959] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.956149] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.956432] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.956613] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.956967] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.957151] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.957615] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.957615] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.957615] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.958680] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: d9bd6893-0205-4ae9-9f12-07dbc827824e is going to be created. [ 1022.979430] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.979662] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.979789] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.980090] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.980332] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.980553] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-d9bd6893-0205-4ae9-9f12-07dbc827824e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.033132] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.034153] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.539024] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.539024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.539024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.539024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.539024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.539024] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b is going to be updated. [ 1023.539024] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.539024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.539024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.539024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.539024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.539024] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a is going to be updated. [ 1023.572019] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.572019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.572019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.572019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.572019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.572019] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.572544] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.574947] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.574947] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.574947] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.584920] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: IN_PROGRESS for 2s [ 1023.585466] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: IN_PROGRESS for 2s [ 1023.738518] env[70013]: INFO networking_nsxv3.common.synchronization [req-11ad4b5a-7894-48b6-959d-7fe30ab59c46 req-5ec909ec-f85b-46ea-8b4b-1e7311f907b9 service nova] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_rules [ 1023.738719] env[70013]: INFO networking_nsxv3.common.synchronization [req-11ad4b5a-7894-48b6-959d-7fe30ab59c46 req-5ec909ec-f85b-46ea-8b4b-1e7311f907b9 service nova] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 1023.738768] env[70013]: INFO networking_nsxv3.common.synchronization [req-11ad4b5a-7894-48b6-959d-7fe30ab59c46 req-5ec909ec-f85b-46ea-8b4b-1e7311f907b9 service nova] Enqueued Resource ID: d9bd6893-0205-4ae9-9f12-07dbc827824e with Priority: HIGHEST for action port [ 1023.739406] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_rules [ 1023.739603] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 1023.739749] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9bd6893-0205-4ae9-9f12-07dbc827824e with Priority: HIGHEST for action port [ 1023.740313] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.740402] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.740462] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.740721] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.740830] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.742444] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.742593] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.742817] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9bd6893-0205-4ae9-9f12-07dbc827824e taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.742931] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9bd6893-0205-4ae9-9f12-07dbc827824e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.743000] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9bd6893-0205-4ae9-9f12-07dbc827824e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.743230] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9bd6893-0205-4ae9-9f12-07dbc827824e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.743343] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9bd6893-0205-4ae9-9f12-07dbc827824e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.030073] env[70013]: INFO networking_nsxv3.common.synchronization [req-50b00f0f-67d6-4a9f-b5c4-a1e2f49d5cab req-4a2f091c-f19d-4176-8473-91652b73f347 tempest-ImagesTestJSON-851757871 tempest-ImagesTestJSON-851757871-project-member] Enqueued Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 1024.031023] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGHEST for action security_group_members [ 1024.031588] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.031588] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.031736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.031915] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.032183] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.032341] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.032454] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.032707] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.032858] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.033030] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.245400] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.245400] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.248965] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d9bd6893-0205-4ae9-9f12-07dbc827824e with status ACTIVE [ 1024.249099] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.249181] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.249224] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.249433] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.249527] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.249710] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.249812] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.249875] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.250041] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.250121] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.250309] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.250404] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.250467] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.250810] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.250810] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.250810] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d9bd6893-0205-4ae9-9f12-07dbc827824e is going to be updated. [ 1024.270293] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.270453] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.270513] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.271043] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.271043] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.271043] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9bd6893-0205-4ae9-9f12-07dbc827824e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.498128] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 in Status: SUCCESS [ 1024.498401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.498572] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.498796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.498995] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.499124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.499189] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.499348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.499428] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.500075] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.500075] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f6998667-5e88-456a-b064-7faf8fc4bfd8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.535276] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.535519] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.535638] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.536053] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.536251] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.536907] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.536907] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.536907] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.537166] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.537372] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.537558] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 is going to be updated. [ 1024.562080] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.562080] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.562080] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.562327] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.562476] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.578202] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: IN_PROGRESS for 2s [ 1024.578872] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0776053c-3635-4232-86b2-1a586b64e542 in Status: SUCCESS [ 1024.579085] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0776053c-3635-4232-86b2-1a586b64e542 deletion is rescheduled due to dependency. [ 1024.579207] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.001792] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6998667-5e88-456a-b064-7faf8fc4bfd8 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.001954] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.002037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.002289] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.002468] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.002571] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.002636] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.002780] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.002869] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.002960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.003123] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6998667-5e88-456a-b064-7faf8fc4bfd8 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.003218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.003277] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.003416] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.003551] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.003638] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.003697] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.003829] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.003905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.003982] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.004083] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f6998667-5e88-456a-b064-7faf8fc4bfd8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.506386] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f6998667-5e88-456a-b064-7faf8fc4bfd8: rpc.has_security_group_logging(os_id): False [ 1025.525621] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.525789] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.525890] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.526164] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.526290] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.526533] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.526653] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.526768] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.526933] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.527833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.527833] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.527833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.527833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.528081] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.528081] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.528359] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.528508] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.528599] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.528798] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.528899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.529161] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 is going to be updated. [ 1025.594550] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.594783] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.594933] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.595205] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.595412] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.600055] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: SUCCESS [ 1025.600309] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.600493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.600749] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.600961] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.601112] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.601180] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.601345] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.601432] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.601528] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.601630] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.603449] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: SUCCESS [ 1025.603734] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.603984] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.604316] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.604596] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.604755] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.604862] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.606617] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.606617] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.606617] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.609817] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 in Status: IN_PROGRESS for 2s [ 1026.114517] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.114517] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.114517] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.114517] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.114517] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.114517] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.114517] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.114517] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.114517] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.114517] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.114517] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.114517] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.114517] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.114517] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.114517] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.114517] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.115233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.115233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.115233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.115233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.115233] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.118838] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.587503] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 in Status: SUCCESS [ 1026.587768] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 deletion is rescheduled due to dependency. [ 1026.587835] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.620609] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16c877e7-f731-49a5-b994-7d74c36c464b: rpc.has_security_group_logging(os_id): False [ 1026.621777] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.638997] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.638997] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.638997] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.639171] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.639254] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.639456] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.639552] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.639609] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.640184] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.640184] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.640184] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.640184] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.640184] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.640379] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.640379] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.640526] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.640606] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.640675] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.640797] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.640871] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.640954] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b is going to be updated. [ 1026.700758] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.701038] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.701038] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.701785] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.701785] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.713659] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: IN_PROGRESS for 2s [ 1027.127034] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.127034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.127034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.127034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.127034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.127034] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a is going to be updated. [ 1027.154186] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.154354] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.154415] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.154654] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.154807] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.163514] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: IN_PROGRESS for 2s [ 1027.621124] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 in Status: SUCCESS [ 1027.621370] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.728308] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: SUCCESS [ 1028.728601] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.031763] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1029.031993] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1029.171889] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: SUCCESS [ 1029.172222] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.172425] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.172937] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.173165] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.173284] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.173367] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.173531] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.173693] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.174199] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.174199] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.241429] env[70013]: INFO networking_nsxv3.common.synchronization [None req-8c7a0ec3-f6ff-451f-b75c-c533a2c1e5bc None None] Enqueued Resource ID: 4949dd96-19d7-4305-a57b-0be256897d93 with Priority: HIGHEST for action port [ 1029.241429] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4949dd96-19d7-4305-a57b-0be256897d93 with Priority: HIGHEST for action port [ 1029.243795] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-4949dd96-19d7-4305-a57b-0be256897d93 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.244017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4949dd96-19d7-4305-a57b-0be256897d93" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.244107] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4949dd96-19d7-4305-a57b-0be256897d93" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.244403] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4949dd96-19d7-4305-a57b-0be256897d93" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.244553] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4949dd96-19d7-4305-a57b-0be256897d93',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.669033] env[70013]: INFO networking_nsxv3.common.synchronization [req-46594279-c9cd-43fa-8048-6df6f9496b25 req-22918527-6c10-4212-8bf9-39fb2914d02f tempest-ServerRescueNegativeTestJSON-1808745105 tempest-ServerRescueNegativeTestJSON-1808745105-project-member] Enqueued Resource ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 with Priority: HIGHEST for action security_group_members [ 1029.670537] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 with Priority: HIGHEST for action security_group_members [ 1029.670537] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f3400e9-8b30-4b29-bde9-85cf198cabf0 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.670537] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.670537] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.672074] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.676017] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.676017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.676017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.676017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.676017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.676017] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f3400e9-8b30-4b29-bde9-85cf198cabf0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.677315] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.677429] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.677507] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.677654] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.677801] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.677896] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.677956] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.678148] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.678230] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.678315] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.678462] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.678549] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.678607] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.678744] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.678872] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.678957] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.679023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.679166] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.679241] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.679319] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.679406] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.748732] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4949dd96-19d7-4305-a57b-0be256897d93 [ 1029.748732] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.748732] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.748732] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.748732] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.748732] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.748732] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4949dd96-19d7-4305-a57b-0be256897d93 already deleted. [ 1029.748732] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4949dd96-19d7-4305-a57b-0be256897d93" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.126585] env[70013]: INFO networking_nsxv3.common.synchronization [req-314b173b-5156-495b-9ef3-9b4340fa6fdb req-dff24fda-cc83-42f8-8baf-a4fe98480e15 tempest-ListServerFiltersTestJSON-1686378133 tempest-ListServerFiltersTestJSON-1686378133-project-member] Enqueued Resource ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 with Priority: HIGHEST for action security_group_members [ 1030.127199] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 with Priority: HIGHEST for action security_group_members [ 1030.127901] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb27dbe1-6f26-411f-bcfc-69daca38eb24 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.128097] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.128176] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.128389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.128670] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.128824] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.128893] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.129102] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.129202] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.129299] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.177095] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.177266] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.177337] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.177635] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.177721] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.177935] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.178046] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.178118] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.178285] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.178361] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.178465] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 already deleted. [ 1030.178545] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.183975] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f422a68f-f64a-4d93-9deb-289ae02aea3a: rpc.has_security_group_logging(os_id): False [ 1030.202953] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.203135] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.203300] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.203416] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.203561] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.203795] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.203910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.203973] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.204168] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.204250] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.204517] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.204633] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.204714] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.204872] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.204933] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.206557] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.206557] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.206557] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.206557] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.206557] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.206799] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a is going to be updated. [ 1030.244022] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-902 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.244230] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-902" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.244363] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-902" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.244752] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-902" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.245048] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.245219] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.245342] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.245583] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.245743] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.245969] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1030.246098] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1030.246210] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1030.246323] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1030.246438] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1030.246550] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1030.246685] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1030.267451] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1030.267653] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1030.267775] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1030.267960] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-902" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.268383] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-9e9d26c4-eeea-4e28-84a1-156d81e4466a taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.268591] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-9e9d26c4-eeea-4e28-84a1-156d81e4466a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.268734] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-9e9d26c4-eeea-4e28-84a1-156d81e4466a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.269082] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-9e9d26c4-eeea-4e28-84a1-156d81e4466a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.269226] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e9d26c4-eeea-4e28-84a1-156d81e4466a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.277592] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.277794] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.277794] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.277978] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.278135] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.290195] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: IN_PROGRESS for 2s [ 1030.471126] env[70013]: INFO networking_nsxv3.common.synchronization [None req-b09c42e2-5d4e-4033-b4e6-1f01b6f9b4ac tempest-AttachInterfacesTestJSON-1580231832 tempest-AttachInterfacesTestJSON-1580231832-project-member] Enqueued Resource ID: df2a8892-05ec-4200-8b30-e8813181f4e5 with Priority: HIGHEST for action security_group_rules [ 1030.471673] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df2a8892-05ec-4200-8b30-e8813181f4e5 with Priority: HIGHEST for action security_group_rules [ 1030.471992] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df2a8892-05ec-4200-8b30-e8813181f4e5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.472139] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df2a8892-05ec-4200-8b30-e8813181f4e5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.472336] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df2a8892-05ec-4200-8b30-e8813181f4e5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.472675] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df2a8892-05ec-4200-8b30-e8813181f4e5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.472767] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df2a8892-05ec-4200-8b30-e8813181f4e5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.551170] env[70013]: INFO networking_nsxv3.common.synchronization [None req-ee5dfe05-da7e-4846-9c7a-1cf52568f6af tempest-AttachInterfacesTestJSON-1580231832 tempest-AttachInterfacesTestJSON-1580231832-project-member] Enqueued Resource ID: df2a8892-05ec-4200-8b30-e8813181f4e5 with Priority: HIGHEST for action security_group_rules [ 1030.551604] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df2a8892-05ec-4200-8b30-e8813181f4e5 with Priority: HIGHEST for action security_group_rules [ 1030.551963] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df2a8892-05ec-4200-8b30-e8813181f4e5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.552069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df2a8892-05ec-4200-8b30-e8813181f4e5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.634529] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.634529] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.634529] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.634529] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.634529] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.635021] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.635905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.635905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.635905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.635905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.635905] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 is going to be updated. [ 1030.661304] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.661746] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.661906] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.662177] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.663212] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.674693] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 in Status: IN_PROGRESS for 2s [ 1030.774644] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.774644] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.774644] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.774644] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.774644] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.774644] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 9e9d26c4-eeea-4e28-84a1-156d81e4466a not found, creating... [ 1030.774644] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.774644] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.775339] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.775665] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.775901] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.776989] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.776989] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.776989] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.776989] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.776989] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.777293] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 9e9d26c4-eeea-4e28-84a1-156d81e4466a is going to be created. [ 1030.805605] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.805605] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.805605] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.805605] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.805605] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.805605] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-9e9d26c4-eeea-4e28-84a1-156d81e4466a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.995048] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.995048] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.995048] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.995306] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.995306] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.995369] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df2a8892-05ec-4200-8b30-e8813181f4e5 already deleted. [ 1030.995449] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df2a8892-05ec-4200-8b30-e8813181f4e5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.995620] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df2a8892-05ec-4200-8b30-e8813181f4e5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.995778] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df2a8892-05ec-4200-8b30-e8813181f4e5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.995862] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df2a8892-05ec-4200-8b30-e8813181f4e5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.515300] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.515469] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.515550] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.515781] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.515846] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.517189] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df2a8892-05ec-4200-8b30-e8813181f4e5 already deleted. [ 1031.517189] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df2a8892-05ec-4200-8b30-e8813181f4e5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.542095] env[70013]: INFO networking_nsxv3.common.synchronization [req-46594279-c9cd-43fa-8048-6df6f9496b25 req-0c7f7203-2812-48aa-bf61-12b4c2871815 service nova] Enqueued Resource ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 with Priority: HIGHEST for action security_group_rules [ 1031.542095] env[70013]: INFO networking_nsxv3.common.synchronization [req-46594279-c9cd-43fa-8048-6df6f9496b25 req-0c7f7203-2812-48aa-bf61-12b4c2871815 service nova] Enqueued Resource ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 with Priority: HIGHEST for action security_group_members [ 1031.542095] env[70013]: INFO networking_nsxv3.common.synchronization [req-46594279-c9cd-43fa-8048-6df6f9496b25 req-0c7f7203-2812-48aa-bf61-12b4c2871815 service nova] Enqueued Resource ID: 9e9d26c4-eeea-4e28-84a1-156d81e4466a with Priority: HIGHEST for action port [ 1031.542452] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 with Priority: HIGHEST for action security_group_rules [ 1031.542452] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 with Priority: HIGHEST for action security_group_members [ 1031.542452] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e9d26c4-eeea-4e28-84a1-156d81e4466a with Priority: HIGHEST for action port [ 1031.542934] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f3400e9-8b30-4b29-bde9-85cf198cabf0 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.543945] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.543945] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.543945] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.543945] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f3400e9-8b30-4b29-bde9-85cf198cabf0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.547332] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f3400e9-8b30-4b29-bde9-85cf198cabf0 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.547332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.547332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.547332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.547332] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.547332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.547332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.547332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.547332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.547332] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f3400e9-8b30-4b29-bde9-85cf198cabf0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.547332] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e9d26c4-eeea-4e28-84a1-156d81e4466a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.547332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e9d26c4-eeea-4e28-84a1-156d81e4466a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.547332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e9d26c4-eeea-4e28-84a1-156d81e4466a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.547332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e9d26c4-eeea-4e28-84a1-156d81e4466a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.547332] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e9d26c4-eeea-4e28-84a1-156d81e4466a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.758108] env[70013]: INFO networking_nsxv3.common.synchronization [None req-e3521d34-6520-4a46-80a6-a1843fd253eb None None] Enqueued Resource ID: 00f7629c-9e0e-4b1e-827e-a00c3ed3d978 with Priority: HIGHEST for action port [ 1031.758775] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f7629c-9e0e-4b1e-827e-a00c3ed3d978 with Priority: HIGHEST for action port [ 1031.759156] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-00f7629c-9e0e-4b1e-827e-a00c3ed3d978 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.759286] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00f7629c-9e0e-4b1e-827e-a00c3ed3d978" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.759354] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00f7629c-9e0e-4b1e-827e-a00c3ed3d978" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.759628] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00f7629c-9e0e-4b1e-827e-a00c3ed3d978" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.759740] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00f7629c-9e0e-4b1e-827e-a00c3ed3d978',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.851791] env[70013]: INFO networking_nsxv3.common.synchronization [req-5d938b12-380a-4861-a71b-7fd579061a68 req-0ef208ca-cf8d-4126-84ce-8963cd999cde tempest-ServerRescueNegativeTestJSON-1808745105 tempest-ServerRescueNegativeTestJSON-1808745105-project-member] Enqueued Resource ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 with Priority: HIGHEST for action security_group_members [ 1031.852442] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 with Priority: HIGHEST for action security_group_members [ 1031.852796] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f3400e9-8b30-4b29-bde9-85cf198cabf0 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.852900] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.051381] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f3400e9-8b30-4b29-bde9-85cf198cabf0 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.052152] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.052152] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f3400e9-8b30-4b29-bde9-85cf198cabf0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.053359] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e9d26c4-eeea-4e28-84a1-156d81e4466a with status ACTIVE [ 1032.053359] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.053522] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.053522] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.053769] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.053893] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.054467] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.054467] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.054722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.058043] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.058043] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.058043] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.058043] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.058043] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.058043] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.058043] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.058043] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e9d26c4-eeea-4e28-84a1-156d81e4466a is going to be updated. [ 1032.080421] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.080627] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.080730] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.081030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.081223] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.081438] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e9d26c4-eeea-4e28-84a1-156d81e4466a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.181942] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-902 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.182188] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-902" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.182541] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-902" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.182630] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-902" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.182931] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.183225] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.183358] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.183614] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.183774] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.183990] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1032.184129] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1032.184245] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1032.184358] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1032.184492] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1032.184600] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1032.184734] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1032.209370] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1032.209556] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1032.209732] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1032.210027] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-902" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.210376] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-36d80bdd-ca39-476a-91b5-601ea7cb1316 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.210560] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-36d80bdd-ca39-476a-91b5-601ea7cb1316" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.210688] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-36d80bdd-ca39-476a-91b5-601ea7cb1316" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.211027] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-36d80bdd-ca39-476a-91b5-601ea7cb1316" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.211175] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36d80bdd-ca39-476a-91b5-601ea7cb1316',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.261744] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 00f7629c-9e0e-4b1e-827e-a00c3ed3d978 [ 1032.261972] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.262150] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.262225] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.262432] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.262636] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.262636] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:00f7629c-9e0e-4b1e-827e-a00c3ed3d978 already deleted. [ 1032.262724] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00f7629c-9e0e-4b1e-827e-a00c3ed3d978" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.303970] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: SUCCESS [ 1032.304218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.558751] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f3400e9-8b30-4b29-bde9-85cf198cabf0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.680452] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 in Status: SUCCESS [ 1032.680452] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 deletion is rescheduled due to dependency. [ 1032.680452] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.717021] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.717021] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.717021] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.717021] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.717021] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.717021] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 36d80bdd-ca39-476a-91b5-601ea7cb1316 not found, creating... [ 1032.717021] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.717021] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.717021] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.717021] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.717021] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.717498] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.717498] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.717716] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.718063] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.718314] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.718555] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 36d80bdd-ca39-476a-91b5-601ea7cb1316 is going to be created. [ 1032.738046] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.738046] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.738205] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.739183] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.739183] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.739183] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-36d80bdd-ca39-476a-91b5-601ea7cb1316" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.063212] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.063462] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.063547] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.063693] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.063809] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.063949] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 is going to be created. [ 1033.086274] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.086418] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.086490] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.086699] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.086920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.095065] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 in Status: UNINITIALIZED for 2s [ 1033.447578] env[70013]: INFO networking_nsxv3.common.synchronization [req-5d938b12-380a-4861-a71b-7fd579061a68 req-5748020c-9591-42a7-8ade-68ad22ba3712 service nova] Enqueued Resource ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 with Priority: HIGHEST for action security_group_rules [ 1033.447789] env[70013]: INFO networking_nsxv3.common.synchronization [req-5d938b12-380a-4861-a71b-7fd579061a68 req-5748020c-9591-42a7-8ade-68ad22ba3712 service nova] Enqueued Resource ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 with Priority: HIGHEST for action security_group_members [ 1033.449419] env[70013]: INFO networking_nsxv3.common.synchronization [req-5d938b12-380a-4861-a71b-7fd579061a68 req-5748020c-9591-42a7-8ade-68ad22ba3712 service nova] Enqueued Resource ID: 36d80bdd-ca39-476a-91b5-601ea7cb1316 with Priority: HIGHEST for action port [ 1033.449419] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 with Priority: HIGHEST for action security_group_rules [ 1033.449419] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 with Priority: HIGHEST for action security_group_members [ 1033.449419] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36d80bdd-ca39-476a-91b5-601ea7cb1316 with Priority: HIGHEST for action port [ 1033.449419] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f3400e9-8b30-4b29-bde9-85cf198cabf0 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.450017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.450257] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f3400e9-8b30-4b29-bde9-85cf198cabf0 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.450377] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.450494] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-36d80bdd-ca39-476a-91b5-601ea7cb1316 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.450595] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36d80bdd-ca39-476a-91b5-601ea7cb1316" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.450659] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36d80bdd-ca39-476a-91b5-601ea7cb1316" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.450861] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36d80bdd-ca39-476a-91b5-601ea7cb1316" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.450943] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36d80bdd-ca39-476a-91b5-601ea7cb1316',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.954068] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36d80bdd-ca39-476a-91b5-601ea7cb1316 with status ACTIVE [ 1033.954172] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.954288] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.954355] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.954603] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.954699] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.954881] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.954980] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.955057] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.955215] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.955294] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.955488] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.955599] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.955666] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.955814] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.955891] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.955979] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36d80bdd-ca39-476a-91b5-601ea7cb1316 is going to be updated. [ 1033.981113] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.981285] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.981320] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.981514] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.981656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.981813] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36d80bdd-ca39-476a-91b5-601ea7cb1316" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.269217] env[70013]: INFO networking_nsxv3.common.synchronization [req-678c186b-0ee3-42e9-a900-e9149e2aecba req-1841816d-6161-4dd2-a35f-19e0798387c7 tempest-DeleteServersTestJSON-1971284771 tempest-DeleteServersTestJSON-1971284771-project-member] Enqueued Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 1034.269704] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 1034.270011] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.270142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.270203] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.270401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.270558] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.270658] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.270721] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.270870] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.270955] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.271058] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.774913] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.774913] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.774913] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.775238] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.775341] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.775638] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.775758] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.775828] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.776015] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.776111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.776205] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b is going to be updated. [ 1034.809466] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.809466] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.809587] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.810415] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.810415] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.819327] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: IN_PROGRESS for 2s [ 1034.897781] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-35 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.898580] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-35" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.898580] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-35" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.898580] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-35" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.900119] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.900119] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.900119] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.900119] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.900119] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.900119] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1034.900119] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1034.900598] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1034.900598] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1034.900678] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1034.900833] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1034.901022] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1034.921850] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1034.922065] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1034.922185] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1034.922374] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-35" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.922843] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-52cf3b73-bbee-4e96-91f2-a1caa2041501 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.923035] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-52cf3b73-bbee-4e96-91f2-a1caa2041501" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.923257] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-52cf3b73-bbee-4e96-91f2-a1caa2041501" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.923433] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-52cf3b73-bbee-4e96-91f2-a1caa2041501" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.923571] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52cf3b73-bbee-4e96-91f2-a1caa2041501',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.106710] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 in Status: SUCCESS [ 1035.106890] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.107060] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.107273] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.107457] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.107572] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.107640] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.107789] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.107871] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.107963] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f3400e9-8b30-4b29-bde9-85cf198cabf0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.426584] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.426870] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.426975] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.427249] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.427406] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.427725] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.427860] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.427984] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.428219] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.428365] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.428683] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.428848] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.428968] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.429249] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.429402] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.429567] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 52cf3b73-bbee-4e96-91f2-a1caa2041501 is going to be updated. [ 1035.449716] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.449954] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.450075] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.450344] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.450546] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.450789] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-52cf3b73-bbee-4e96-91f2-a1caa2041501" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.610547] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f3400e9-8b30-4b29-bde9-85cf198cabf0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.113201] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f3400e9-8b30-4b29-bde9-85cf198cabf0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.186298] env[70013]: INFO networking_nsxv3.common.synchronization [req-7dff48fc-ed7e-432a-a992-52d280f60f9d req-2d803a63-8c10-445c-93a6-f26d20134f38 service nova] Enqueued Resource ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 with Priority: HIGHEST for action security_group_rules [ 1036.186490] env[70013]: INFO networking_nsxv3.common.synchronization [req-7dff48fc-ed7e-432a-a992-52d280f60f9d req-2d803a63-8c10-445c-93a6-f26d20134f38 service nova] Enqueued Resource ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 with Priority: HIGHEST for action security_group_members [ 1036.186634] env[70013]: INFO networking_nsxv3.common.synchronization [req-7dff48fc-ed7e-432a-a992-52d280f60f9d req-2d803a63-8c10-445c-93a6-f26d20134f38 service nova] Enqueued Resource ID: 52cf3b73-bbee-4e96-91f2-a1caa2041501 with Priority: HIGHEST for action port [ 1036.186867] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 with Priority: HIGHEST for action security_group_rules [ 1036.186992] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 with Priority: HIGHEST for action security_group_members [ 1036.187102] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52cf3b73-bbee-4e96-91f2-a1caa2041501 with Priority: HIGHEST for action port [ 1036.187672] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b51e70d-5edb-4332-99e9-eb53e6015365 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.187799] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.187867] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.188081] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.188164] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.189269] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b51e70d-5edb-4332-99e9-eb53e6015365 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.189385] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.189454] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.189622] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.189769] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.189931] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.189931] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.190113] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.190147] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.190231] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.190948] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-52cf3b73-bbee-4e96-91f2-a1caa2041501 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.191256] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52cf3b73-bbee-4e96-91f2-a1caa2041501" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.191256] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52cf3b73-bbee-4e96-91f2-a1caa2041501" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.191320] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52cf3b73-bbee-4e96-91f2-a1caa2041501" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.191346] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52cf3b73-bbee-4e96-91f2-a1caa2041501',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.618641] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.618923] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.618923] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.619119] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.619215] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.619316] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 is going to be updated. [ 1036.650493] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.650493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.650493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.650493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.650493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.657835] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 in Status: IN_PROGRESS for 2s [ 1036.693993] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b51e70d-5edb-4332-99e9-eb53e6015365 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.694126] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.694291] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.695375] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52cf3b73-bbee-4e96-91f2-a1caa2041501 with status ACTIVE [ 1036.695575] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.695694] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.695766] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.695972] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.696093] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.696239] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.697032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.697032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.697032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.697032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.697032] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.697032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.697032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.697284] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.697284] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.697284] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52cf3b73-bbee-4e96-91f2-a1caa2041501 is going to be updated. [ 1036.718547] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.718692] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.718761] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.718963] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.720035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.720035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52cf3b73-bbee-4e96-91f2-a1caa2041501" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.831980] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: SUCCESS [ 1036.832195] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b deletion is rescheduled due to dependency. [ 1036.832312] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.199432] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.702029] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.702029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.702393] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.702393] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.702505] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.702552] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 is going to be updated. [ 1037.731734] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.731889] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.732042] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.732424] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.732575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.748124] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 in Status: IN_PROGRESS for 2s [ 1038.668865] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 in Status: SUCCESS [ 1038.669182] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.669423] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.669703] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.669940] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.670078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.670175] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.670352] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.670452] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.670560] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.670664] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f3400e9-8b30-4b29-bde9-85cf198cabf0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.671764] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.671943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.672128] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.672379] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.672379] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.672967] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.672967] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.672967] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f3400e9-8b30-4b29-bde9-85cf198cabf0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.688227] env[70013]: INFO networking_nsxv3.common.synchronization [req-f1bc1af3-9678-4b46-b56a-3cacdfecca51 req-388fa085-ea76-4572-b540-7babad4efa28 tempest-ServerDiskConfigTestJSON-536876121 tempest-ServerDiskConfigTestJSON-536876121-project-member] Enqueued Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1038.688406] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1038.692153] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.692153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.692153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.692153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.692153] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.692153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.692153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.692153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.692153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.692153] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.989140] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-194 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.989438] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-194" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.989477] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-194" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.989826] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-194" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.990117] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.990281] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.990401] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.990661] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.990828] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.991098] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1038.991222] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1038.991333] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1038.991446] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1038.991561] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1038.991671] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1038.991827] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1039.011933] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1039.012143] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1039.012327] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1039.012593] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-194" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.012959] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-12ace8f2-7b35-437a-aba2-e371201f3343 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.013172] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-12ace8f2-7b35-437a-aba2-e371201f3343" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.013364] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-12ace8f2-7b35-437a-aba2-e371201f3343" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.013757] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-12ace8f2-7b35-437a-aba2-e371201f3343" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.013924] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12ace8f2-7b35-437a-aba2-e371201f3343',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.174839] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f3400e9-8b30-4b29-bde9-85cf198cabf0 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.175087] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.175270] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f3400e9-8b30-4b29-bde9-85cf198cabf0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.196363] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.196540] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.196597] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.196869] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.196980] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.197204] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.197345] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.197411] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.197587] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.197671] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.197786] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f8a4673-59c5-493b-8250-617958bf996b already deleted. [ 1039.197884] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.518198] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.518198] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.518198] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.518198] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.518198] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.518198] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 12ace8f2-7b35-437a-aba2-e371201f3343 not found, creating... [ 1039.518198] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.518198] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.518198] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.518884] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.519208] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.519635] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.519926] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.520149] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.520500] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.520745] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.521065] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 12ace8f2-7b35-437a-aba2-e371201f3343 is going to be created. [ 1039.543975] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.543975] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.543975] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.543975] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.543975] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.543975] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-12ace8f2-7b35-437a-aba2-e371201f3343" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.680427] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f3400e9-8b30-4b29-bde9-85cf198cabf0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.763025] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 in Status: SUCCESS [ 1039.763025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.763025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.763025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.763025] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.763025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.763025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.763025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.763025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.763025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.763025] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.184696] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.185065] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.185065] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.185170] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.185263] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.185368] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 is going to be updated. [ 1040.214263] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.214459] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.214459] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.214743] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.214893] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.223542] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 in Status: IN_PROGRESS for 2s [ 1040.240677] env[70013]: INFO networking_nsxv3.common.synchronization [req-f1bc1af3-9678-4b46-b56a-3cacdfecca51 req-ed2e0a28-0d40-4b1f-b530-b1a6e43d098f service nova] Enqueued Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_rules [ 1040.240861] env[70013]: INFO networking_nsxv3.common.synchronization [req-f1bc1af3-9678-4b46-b56a-3cacdfecca51 req-ed2e0a28-0d40-4b1f-b530-b1a6e43d098f service nova] Enqueued Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1040.241007] env[70013]: INFO networking_nsxv3.common.synchronization [req-f1bc1af3-9678-4b46-b56a-3cacdfecca51 req-ed2e0a28-0d40-4b1f-b530-b1a6e43d098f service nova] Enqueued Resource ID: 12ace8f2-7b35-437a-aba2-e371201f3343 with Priority: HIGHEST for action port [ 1040.241241] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_rules [ 1040.241368] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1040.241463] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12ace8f2-7b35-437a-aba2-e371201f3343 with Priority: HIGHEST for action port [ 1040.242008] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.242213] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.242337] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.242592] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.242637] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.243758] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.243898] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.243932] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.245045] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.245045] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.245045] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.245045] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.245045] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.245045] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.245045] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.246020] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-12ace8f2-7b35-437a-aba2-e371201f3343 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.246161] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12ace8f2-7b35-437a-aba2-e371201f3343" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.246224] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12ace8f2-7b35-437a-aba2-e371201f3343" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.246392] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12ace8f2-7b35-437a-aba2-e371201f3343" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.246471] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12ace8f2-7b35-437a-aba2-e371201f3343',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.267260] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b51e70d-5edb-4332-99e9-eb53e6015365 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.267408] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.267468] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.267660] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.267818] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.267918] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.267982] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.268150] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.268239] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.268328] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.268476] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b51e70d-5edb-4332-99e9-eb53e6015365 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.268569] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.268630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.268769] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.268905] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.268996] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.269070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.269209] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.269284] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.269363] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.269448] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.748054] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.749205] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.749338] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.750641] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12ace8f2-7b35-437a-aba2-e371201f3343 with status ACTIVE [ 1040.750641] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.750641] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.750641] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.750641] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.750641] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.750902] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.750902] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.750902] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.751496] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.751496] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.751496] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.751678] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.751678] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.752018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.752191] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.752316] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12ace8f2-7b35-437a-aba2-e371201f3343 is going to be updated. [ 1040.771288] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b51e70d-5edb-4332-99e9-eb53e6015365: rpc.has_security_group_logging(os_id): False [ 1040.773650] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.773783] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.773856] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.774077] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.774214] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.774364] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12ace8f2-7b35-437a-aba2-e371201f3343" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.792451] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.792451] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.792674] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.792854] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.817587] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.817926] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.818071] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.818164] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.818463] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.818573] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.818791] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.818896] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.818954] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.819175] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.819320] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.819603] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.819696] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.819770] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.819921] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.819998] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.820101] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 is going to be updated. [ 1040.930337] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.930507] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.930964] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.930964] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.930964] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.950312] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 in Status: IN_PROGRESS for 2s [ 1041.255528] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.758439] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.758629] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.758674] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.758995] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.759046] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.759151] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f8a4673-59c5-493b-8250-617958bf996b is going to be created. [ 1041.792723] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.792723] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.792906] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.793170] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.793317] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.807367] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: UNINITIALIZED for 2s [ 1042.242093] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 in Status: SUCCESS [ 1042.242333] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.242541] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.242837] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.243052] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.243173] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.243234] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.243393] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.243475] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.243587] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.243755] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f3400e9-8b30-4b29-bde9-85cf198cabf0 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.243852] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.243915] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.244265] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.244414] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.244511] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.244580] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.244774] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.246606] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.246606] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.246606] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f3400e9-8b30-4b29-bde9-85cf198cabf0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.574232] env[70013]: INFO networking_nsxv3.common.synchronization [None req-6e9dc738-d415-4d86-9b13-7993679831ad tempest-ServerActionsTestOtherA-108106573 tempest-ServerActionsTestOtherA-108106573-project-member] Enqueued Resource ID: e555b24f-3b58-40b7-8837-06aac9343ba3 with Priority: HIGHEST for action security_group_rules [ 1042.574825] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e555b24f-3b58-40b7-8837-06aac9343ba3 with Priority: HIGHEST for action security_group_rules [ 1042.575154] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e555b24f-3b58-40b7-8837-06aac9343ba3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.575280] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e555b24f-3b58-40b7-8837-06aac9343ba3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.575348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e555b24f-3b58-40b7-8837-06aac9343ba3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.575601] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e555b24f-3b58-40b7-8837-06aac9343ba3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.575705] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e555b24f-3b58-40b7-8837-06aac9343ba3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.670380] env[70013]: INFO networking_nsxv3.common.synchronization [None req-e538c75b-ef53-49ed-8b8e-f75673735364 tempest-ServerActionsTestOtherA-108106573 tempest-ServerActionsTestOtherA-108106573-project-member] Enqueued Resource ID: e555b24f-3b58-40b7-8837-06aac9343ba3 with Priority: HIGHEST for action security_group_rules [ 1042.671169] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e555b24f-3b58-40b7-8837-06aac9343ba3 with Priority: HIGHEST for action security_group_rules [ 1042.671492] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e555b24f-3b58-40b7-8837-06aac9343ba3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.671598] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e555b24f-3b58-40b7-8837-06aac9343ba3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.747218] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f3400e9-8b30-4b29-bde9-85cf198cabf0: rpc.has_security_group_logging(os_id): False [ 1042.765384] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.765657] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.765729] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.765963] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.766121] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.766441] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.766582] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.766697] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.766909] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.767028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.767289] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.767423] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.767518] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.767713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.767827] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.768091] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.768231] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.768320] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.768508] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.768622] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.768744] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 is going to be created. [ 1042.824727] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.824887] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.824935] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.825196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.826047] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.838802] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 in Status: IN_PROGRESS for 2s [ 1042.967361] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 in Status: SUCCESS [ 1042.967361] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.097616] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.097616] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.097616] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.097616] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.097616] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.097616] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e555b24f-3b58-40b7-8837-06aac9343ba3 already deleted. [ 1043.097616] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e555b24f-3b58-40b7-8837-06aac9343ba3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.097616] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e555b24f-3b58-40b7-8837-06aac9343ba3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.097616] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e555b24f-3b58-40b7-8837-06aac9343ba3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.097616] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e555b24f-3b58-40b7-8837-06aac9343ba3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.618942] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.619253] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.620650] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.620991] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.621142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.621287] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e555b24f-3b58-40b7-8837-06aac9343ba3 already deleted. [ 1043.621446] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e555b24f-3b58-40b7-8837-06aac9343ba3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.817423] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: SUCCESS [ 1043.817888] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.818428] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.818731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.819071] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.819335] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.819553] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.819829] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.820411] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.820501] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.820621] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.323591] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.323761] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.323881] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.324193] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.324477] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.324657] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.324799] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.325041] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.325168] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.325266] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.325718] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.325718] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.325718] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.325855] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.326082] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.326204] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.326264] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.326416] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.326506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.326612] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.326717] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.829411] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f8a4673-59c5-493b-8250-617958bf996b: rpc.has_security_group_logging(os_id): False [ 1044.847873] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.848061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.848117] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.848306] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.848390] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.848611] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.848727] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.848818] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.849067] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.849169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.849368] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.849471] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.849549] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.849704] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.849803] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.850072] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.850219] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.850292] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.850442] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.850519] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.850608] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f8a4673-59c5-493b-8250-617958bf996b is going to be created. [ 1044.852232] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 in Status: SUCCESS [ 1044.852420] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.852977] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.853210] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.853315] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f3400e9-8b30-4b29-bde9-85cf198cabf0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.908255] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.908499] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.908557] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.908865] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.909145] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.921545] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: IN_PROGRESS for 2s [ 1045.355510] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f3400e9-8b30-4b29-bde9-85cf198cabf0 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.355772] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.355888] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.360027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.360027] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.360027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.360027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.360027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.360027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.360027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.360027] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f3400e9-8b30-4b29-bde9-85cf198cabf0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.731406] env[70013]: INFO networking_nsxv3.common.synchronization [req-d0008684-3e2e-4e51-947e-d302a2eeb8c9 req-b64904c6-9a10-42b0-b781-99c8d0912d73 tempest-AttachVolumeTestJSON-972861423 tempest-AttachVolumeTestJSON-972861423-project-member] Enqueued Resource ID: f3b902d5-ffa1-4a45-b449-3b726cf76855 with Priority: HIGHEST for action security_group_members [ 1045.731466] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b902d5-ffa1-4a45-b449-3b726cf76855 with Priority: HIGHEST for action security_group_members [ 1045.731769] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3b902d5-ffa1-4a45-b449-3b726cf76855 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.732099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.732099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.732189] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.733135] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.733135] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.733135] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.733135] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.733135] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.733135] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3b902d5-ffa1-4a45-b449-3b726cf76855',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.860470] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f3400e9-8b30-4b29-bde9-85cf198cabf0 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.860777] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.860777] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.860924] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.861116] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.861252] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.861289] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.861423] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.861582] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.861582] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.861732] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f3400e9-8b30-4b29-bde9-85cf198cabf0 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.861826] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.861887] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.862047] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.862186] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.862276] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.862369] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.862469] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.862543] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.862624] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.862713] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f3400e9-8b30-4b29-bde9-85cf198cabf0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.125028] env[70013]: INFO networking_nsxv3.common.synchronization [req-12405c8e-d864-4f6b-b515-ff2357d0da1e req-208ef6c9-0a45-463e-a837-7fd39f473686 tempest-ServerRescueTestJSON-1890363448 tempest-ServerRescueTestJSON-1890363448-project-member] Enqueued Resource ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 with Priority: HIGHEST for action security_group_members [ 1046.125028] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 with Priority: HIGHEST for action security_group_members [ 1046.125028] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6998667-5e88-456a-b064-7faf8fc4bfd8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.125630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.125827] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.126142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.127793] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.127793] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.127793] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.127793] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.127793] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.127793] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6998667-5e88-456a-b064-7faf8fc4bfd8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.235652] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.235842] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.235920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.236199] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.236299] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.236559] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.236663] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.236731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.236935] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.237011] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.237106] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3b902d5-ffa1-4a45-b449-3b726cf76855 is going to be updated. [ 1046.284940] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.285198] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.285289] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.285516] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.285702] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.298154] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b902d5-ffa1-4a45-b449-3b726cf76855 in Status: IN_PROGRESS for 2s [ 1046.365731] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f3400e9-8b30-4b29-bde9-85cf198cabf0: rpc.has_security_group_logging(os_id): False [ 1046.384278] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.384278] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.384666] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.384712] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.384830] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.385146] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.385465] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.385465] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.385595] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.385668] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.385906] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.386019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.386089] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.386242] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.386330] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.386637] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.386753] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.386836] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.387023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.387105] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.387210] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 is going to be updated. [ 1046.449412] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.450039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.450039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.450039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.450039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.461803] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 in Status: IN_PROGRESS for 2s [ 1046.630393] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f6998667-5e88-456a-b064-7faf8fc4bfd8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.934066] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: SUCCESS [ 1046.934409] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.132112] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f6998667-5e88-456a-b064-7faf8fc4bfd8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.637862] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.638094] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.638094] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.638326] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.638457] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.638593] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 is going to be updated. [ 1047.665788] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.665788] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.665788] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.665788] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.666096] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.675238] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 in Status: IN_PROGRESS for 2s [ 1048.318380] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3b902d5-ffa1-4a45-b449-3b726cf76855 in Status: SUCCESS [ 1048.318666] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3b902d5-ffa1-4a45-b449-3b726cf76855 deletion is rescheduled due to dependency. [ 1048.319683] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.480133] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 in Status: SUCCESS [ 1048.480447] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.684985] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 in Status: SUCCESS [ 1049.685291] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.126346] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1051.126723] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1051.169028] env[70013]: INFO networking_nsxv3.common.synchronization [req-e0c90b65-6fa2-406b-823f-784c1bfc90e4 req-02fa61e6-a3ab-4225-8ec7-71f9ae98a2cf tempest-AttachVolumeNegativeTest-680083968 tempest-AttachVolumeNegativeTest-680083968-project-member] Enqueued Resource ID: f43167c6-5d75-4a22-ac5d-d671524fba53 with Priority: HIGHEST for action security_group_members [ 1051.169028] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f43167c6-5d75-4a22-ac5d-d671524fba53 with Priority: HIGHEST for action security_group_members [ 1051.169028] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f43167c6-5d75-4a22-ac5d-d671524fba53 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.169028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.169028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.169028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.169028] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.169028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.169028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.169028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.169028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.169028] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f43167c6-5d75-4a22-ac5d-d671524fba53',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.673467] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.673467] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.673467] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.673467] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.695700] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.696722] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.696722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.696722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.696722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.696722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.696722] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f43167c6-5d75-4a22-ac5d-d671524fba53 is going to be updated. [ 1051.724641] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.724801] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.724877] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.725084] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.725223] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.733618] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f43167c6-5d75-4a22-ac5d-d671524fba53 in Status: IN_PROGRESS for 2s [ 1053.750928] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f43167c6-5d75-4a22-ac5d-d671524fba53 in Status: SUCCESS [ 1053.751313] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f43167c6-5d75-4a22-ac5d-d671524fba53 deletion is rescheduled due to dependency. [ 1053.753622] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.449456] env[70013]: INFO networking_nsxv3.common.synchronization [req-05a9fe88-b7e5-4ebd-94e7-8ed34aaa0c73 req-2f16bb22-9251-4aba-b82e-7e89563370bb tempest-ServerTagsTestJSON-601315959 tempest-ServerTagsTestJSON-601315959-project-member] Enqueued Resource ID: e4d87c55-80bd-46c8-8078-256c25d0bf4b with Priority: HIGHEST for action security_group_members [ 1054.450021] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4d87c55-80bd-46c8-8078-256c25d0bf4b with Priority: HIGHEST for action security_group_members [ 1054.450397] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4d87c55-80bd-46c8-8078-256c25d0bf4b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.450501] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.450536] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.450768] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.450925] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.451038] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.451099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.451409] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.451514] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.451756] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4d87c55-80bd-46c8-8078-256c25d0bf4b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.859009] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-397 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.859009] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-397" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.859321] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-397" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.859737] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-397" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.860219] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.860431] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.860603] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.860911] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.861147] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.862307] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1054.862307] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1054.862307] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1054.862307] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1054.862781] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1054.862937] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1054.863117] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1054.884139] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1054.884317] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1054.884521] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1054.884765] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-397" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.885444] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-658a9776-9b7b-4d90-86b3-79a86023c519 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.885444] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-658a9776-9b7b-4d90-86b3-79a86023c519" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.885444] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-658a9776-9b7b-4d90-86b3-79a86023c519" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.885822] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-658a9776-9b7b-4d90-86b3-79a86023c519" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.886243] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('658a9776-9b7b-4d90-86b3-79a86023c519',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.954062] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.955115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.955115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.955115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.955115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.955115] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.955115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.955115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.955115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.955351] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.955351] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4d87c55-80bd-46c8-8078-256c25d0bf4b already deleted. [ 1054.955351] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.388417] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.388678] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.388813] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.389252] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.389420] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.389597] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 658a9776-9b7b-4d90-86b3-79a86023c519 not found, creating... [ 1055.389886] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.390072] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.390199] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.390441] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.390615] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.390878] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.391050] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.391188] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.391504] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.391542] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.391671] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 658a9776-9b7b-4d90-86b3-79a86023c519 is going to be created. [ 1055.423405] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.423648] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.423780] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.424066] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.424893] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.424893] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-658a9776-9b7b-4d90-86b3-79a86023c519" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.406695] env[70013]: INFO networking_nsxv3.common.synchronization [req-05a9fe88-b7e5-4ebd-94e7-8ed34aaa0c73 req-9cfe1657-e497-4840-abc8-68c8b3d36899 service nova] Enqueued Resource ID: e4d87c55-80bd-46c8-8078-256c25d0bf4b with Priority: HIGHEST for action security_group_rules [ 1056.407144] env[70013]: INFO networking_nsxv3.common.synchronization [req-05a9fe88-b7e5-4ebd-94e7-8ed34aaa0c73 req-9cfe1657-e497-4840-abc8-68c8b3d36899 service nova] Enqueued Resource ID: e4d87c55-80bd-46c8-8078-256c25d0bf4b with Priority: HIGHEST for action security_group_members [ 1056.407144] env[70013]: INFO networking_nsxv3.common.synchronization [req-05a9fe88-b7e5-4ebd-94e7-8ed34aaa0c73 req-9cfe1657-e497-4840-abc8-68c8b3d36899 service nova] Enqueued Resource ID: 658a9776-9b7b-4d90-86b3-79a86023c519 with Priority: HIGHEST for action port [ 1056.409676] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4d87c55-80bd-46c8-8078-256c25d0bf4b with Priority: HIGHEST for action security_group_rules [ 1056.409821] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4d87c55-80bd-46c8-8078-256c25d0bf4b with Priority: HIGHEST for action security_group_members [ 1056.409922] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 658a9776-9b7b-4d90-86b3-79a86023c519 with Priority: HIGHEST for action port [ 1056.410351] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4d87c55-80bd-46c8-8078-256c25d0bf4b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.410527] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.410557] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.410798] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.410883] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4d87c55-80bd-46c8-8078-256c25d0bf4b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.411725] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4d87c55-80bd-46c8-8078-256c25d0bf4b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.411863] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.411934] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.412140] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.412305] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.412386] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.412433] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.412599] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.412731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.412815] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4d87c55-80bd-46c8-8078-256c25d0bf4b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.417018] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-658a9776-9b7b-4d90-86b3-79a86023c519 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.417018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-658a9776-9b7b-4d90-86b3-79a86023c519" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.417018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-658a9776-9b7b-4d90-86b3-79a86023c519" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.417018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-658a9776-9b7b-4d90-86b3-79a86023c519" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.417018] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('658a9776-9b7b-4d90-86b3-79a86023c519',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.728768] env[70013]: INFO networking_nsxv3.common.synchronization [req-2b0b2ba1-b1e1-441c-a972-aa20b1a54e58 req-0a4d4b82-99a6-4674-9fa2-ab672de25401 tempest-AttachInterfacesUnderV243Test-760224301 tempest-AttachInterfacesUnderV243Test-760224301-project-member] Enqueued Resource ID: bb3e5499-be65-479e-916c-2fb08083e417 with Priority: HIGHEST for action security_group_members [ 1056.729340] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb3e5499-be65-479e-916c-2fb08083e417 with Priority: HIGHEST for action security_group_members [ 1056.729654] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb3e5499-be65-479e-916c-2fb08083e417 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.729799] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.729867] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.730921] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.731119] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.731247] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.732148] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.732148] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.732148] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.732148] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb3e5499-be65-479e-916c-2fb08083e417',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.790896] env[70013]: INFO networking_nsxv3.common.synchronization [req-2b0b2ba1-b1e1-441c-a972-aa20b1a54e58 req-0a4d4b82-99a6-4674-9fa2-ab672de25401 tempest-AttachInterfacesUnderV243Test-760224301 tempest-AttachInterfacesUnderV243Test-760224301-project-member] Enqueued Resource ID: bb3e5499-be65-479e-916c-2fb08083e417 with Priority: HIGHEST for action security_group_rules [ 1056.791643] env[70013]: INFO networking_nsxv3.common.synchronization [req-2b0b2ba1-b1e1-441c-a972-aa20b1a54e58 req-0a4d4b82-99a6-4674-9fa2-ab672de25401 tempest-AttachInterfacesUnderV243Test-760224301 tempest-AttachInterfacesUnderV243Test-760224301-project-member] Enqueued Resource ID: bb3e5499-be65-479e-916c-2fb08083e417 with Priority: HIGHEST for action security_group_members [ 1056.791643] env[70013]: INFO networking_nsxv3.common.synchronization [req-2b0b2ba1-b1e1-441c-a972-aa20b1a54e58 req-0a4d4b82-99a6-4674-9fa2-ab672de25401 tempest-AttachInterfacesUnderV243Test-760224301 tempest-AttachInterfacesUnderV243Test-760224301-project-member] Enqueued Resource ID: 92b2e42f-1b28-4c86-a59d-e06f2adc11da with Priority: HIGHEST for action port [ 1056.793428] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb3e5499-be65-479e-916c-2fb08083e417 with Priority: HIGHEST for action security_group_rules [ 1056.793428] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb3e5499-be65-479e-916c-2fb08083e417 with Priority: HIGHEST for action security_group_members [ 1056.793428] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92b2e42f-1b28-4c86-a59d-e06f2adc11da with Priority: HIGHEST for action port [ 1056.793428] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb3e5499-be65-479e-916c-2fb08083e417 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.793428] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.793428] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.794017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.794017] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb3e5499-be65-479e-916c-2fb08083e417',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.794521] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb3e5499-be65-479e-916c-2fb08083e417 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.794656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.794909] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-92b2e42f-1b28-4c86-a59d-e06f2adc11da taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.795028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92b2e42f-1b28-4c86-a59d-e06f2adc11da" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.795193] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92b2e42f-1b28-4c86-a59d-e06f2adc11da" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.795298] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92b2e42f-1b28-4c86-a59d-e06f2adc11da" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.795376] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92b2e42f-1b28-4c86-a59d-e06f2adc11da',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.915435] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4d87c55-80bd-46c8-8078-256c25d0bf4b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.916820] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4d87c55-80bd-46c8-8078-256c25d0bf4b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.917029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.918623] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 658a9776-9b7b-4d90-86b3-79a86023c519 with status ACTIVE [ 1056.918861] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.919029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.919116] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.919419] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.919498] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.919696] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.919790] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.919860] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.920035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.920117] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.920295] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.920393] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.920442] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.921012] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.921115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.921466] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 658a9776-9b7b-4d90-86b3-79a86023c519 is going to be updated. [ 1056.946357] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.946646] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.946646] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.946762] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.947152] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.947152] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-658a9776-9b7b-4d90-86b3-79a86023c519" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.237672] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb3e5499-be65-479e-916c-2fb08083e417',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.297669] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb3e5499-be65-479e-916c-2fb08083e417 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.297794] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.297978] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 92b2e42f-1b28-4c86-a59d-e06f2adc11da with status ACTIVE [ 1057.298158] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.298263] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.298329] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.298833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.298833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.298833] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.299013] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.299013] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.299077] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.299154] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.299330] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.299421] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.299537] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.299619] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.299694] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.299809] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 92b2e42f-1b28-4c86-a59d-e06f2adc11da is going to be updated. [ 1057.331213] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.331355] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.331425] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.331970] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.331970] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.331970] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92b2e42f-1b28-4c86-a59d-e06f2adc11da" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.418395] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4d87c55-80bd-46c8-8078-256c25d0bf4b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.743398] env[70013]: INFO networking_nsxv3.common.synchronization [req-0a63dc1a-d80e-4aac-9f33-93296e9294b9 req-a5c6cc88-ab6f-43cf-9694-57f8a59e1908 tempest-AttachInterfacesTestJSON-1580231832 tempest-AttachInterfacesTestJSON-1580231832-project-member] Enqueued Resource ID: df2a8892-05ec-4200-8b30-e8813181f4e5 with Priority: HIGHEST for action security_group_members [ 1057.743398] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb3e5499-be65-479e-916c-2fb08083e417',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.744191] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df2a8892-05ec-4200-8b30-e8813181f4e5 with Priority: HIGHEST for action security_group_members [ 1057.744918] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-df2a8892-05ec-4200-8b30-e8813181f4e5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.747404] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df2a8892-05ec-4200-8b30-e8813181f4e5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.747404] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df2a8892-05ec-4200-8b30-e8813181f4e5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.747404] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df2a8892-05ec-4200-8b30-e8813181f4e5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.747404] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.747404] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.747404] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.747404] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.747404] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.747404] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df2a8892-05ec-4200-8b30-e8813181f4e5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.921967] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.922149] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.922221] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.922452] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.922540] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.923699] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4d87c55-80bd-46c8-8078-256c25d0bf4b is going to be created. [ 1057.947380] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.947380] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.947380] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.948127] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.948293] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.958154] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4d87c55-80bd-46c8-8078-256c25d0bf4b in Status: UNINITIALIZED for 2s [ 1058.245733] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.245923] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.246244] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.246382] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.246468] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.246530] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb3e5499-be65-479e-916c-2fb08083e417 is going to be updated. [ 1058.251441] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.251630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.251630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.251828] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.251921] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.252117] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.252235] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.252288] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.252451] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.252561] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.252656] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df2a8892-05ec-4200-8b30-e8813181f4e5 already deleted. [ 1058.252748] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df2a8892-05ec-4200-8b30-e8813181f4e5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.296518] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.296518] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.296687] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.296823] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.297095] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.309381] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb3e5499-be65-479e-916c-2fb08083e417 in Status: IN_PROGRESS for 2s [ 1058.467018] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.467018] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.467018] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.467018] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.467018] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.467018] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.467018] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.467810] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.468120] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.468438] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1058.468696] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1058.471149] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1058.471149] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1058.471149] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1058.471149] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1058.471149] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1058.489606] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1058.489804] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1058.489963] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1058.490188] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.490552] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-179ff8c1-53f9-4484-9dce-1fd85174d71d taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.490762] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-179ff8c1-53f9-4484-9dce-1fd85174d71d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.490933] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-179ff8c1-53f9-4484-9dce-1fd85174d71d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.491323] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-179ff8c1-53f9-4484-9dce-1fd85174d71d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.491501] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('179ff8c1-53f9-4484-9dce-1fd85174d71d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.995738] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.996123] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.996252] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.996629] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.997339] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.997339] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 179ff8c1-53f9-4484-9dce-1fd85174d71d not found, creating... [ 1058.997533] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.997832] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.998025] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.998508] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.998712] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.999079] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.999348] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.999564] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.999989] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.000118] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.000374] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 179ff8c1-53f9-4484-9dce-1fd85174d71d is going to be created. [ 1059.023589] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.023796] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.023927] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.024236] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.024472] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.024698] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-179ff8c1-53f9-4484-9dce-1fd85174d71d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.187041] env[70013]: INFO networking_nsxv3.common.synchronization [None req-6ca489a0-b4f5-4c29-b921-972b06a021cb None None] Enqueued Resource ID: 8ac837d7-73c0-48bc-b9fc-6ca9307372dd with Priority: HIGHEST for action port [ 1059.187041] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ac837d7-73c0-48bc-b9fc-6ca9307372dd with Priority: HIGHEST for action port [ 1059.187041] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ac837d7-73c0-48bc-b9fc-6ca9307372dd taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.187041] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ac837d7-73c0-48bc-b9fc-6ca9307372dd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.187041] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ac837d7-73c0-48bc-b9fc-6ca9307372dd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.187041] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ac837d7-73c0-48bc-b9fc-6ca9307372dd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.187041] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ac837d7-73c0-48bc-b9fc-6ca9307372dd',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.571160] env[70013]: INFO networking_nsxv3.common.synchronization [req-8f2e9acf-52ca-41f2-abfb-11791fe2976c req-6fca9742-36a4-4873-98c6-19841cfadb71 tempest-ServersTestJSON-1543902807 tempest-ServersTestJSON-1543902807-project-member] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 1059.571698] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 1059.571998] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.574294] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.574413] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.574611] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.574839] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.574946] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.575018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.575194] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.575428] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.575428] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.694186] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ac837d7-73c0-48bc-b9fc-6ca9307372dd [ 1059.695054] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.696036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.696036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.696036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.696183] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.696183] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ac837d7-73c0-48bc-b9fc-6ca9307372dd already deleted. [ 1059.696262] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ac837d7-73c0-48bc-b9fc-6ca9307372dd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.968134] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4d87c55-80bd-46c8-8078-256c25d0bf4b in Status: SUCCESS [ 1059.968210] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.968365] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.968628] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.968844] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.969217] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.969308] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.969501] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.969587] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.969680] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.969786] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4d87c55-80bd-46c8-8078-256c25d0bf4b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.073328] env[70013]: INFO networking_nsxv3.common.synchronization [req-0a63dc1a-d80e-4aac-9f33-93296e9294b9 req-e95fe3cd-71e8-4233-b39c-d5c3ba4b0f8e service nova] Enqueued Resource ID: df2a8892-05ec-4200-8b30-e8813181f4e5 with Priority: HIGHEST for action security_group_rules [ 1060.073328] env[70013]: INFO networking_nsxv3.common.synchronization [req-0a63dc1a-d80e-4aac-9f33-93296e9294b9 req-e95fe3cd-71e8-4233-b39c-d5c3ba4b0f8e service nova] Enqueued Resource ID: df2a8892-05ec-4200-8b30-e8813181f4e5 with Priority: HIGHEST for action security_group_members [ 1060.073328] env[70013]: INFO networking_nsxv3.common.synchronization [req-0a63dc1a-d80e-4aac-9f33-93296e9294b9 req-e95fe3cd-71e8-4233-b39c-d5c3ba4b0f8e service nova] Enqueued Resource ID: 179ff8c1-53f9-4484-9dce-1fd85174d71d with Priority: HIGHEST for action port [ 1060.073328] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df2a8892-05ec-4200-8b30-e8813181f4e5 with Priority: HIGHEST for action security_group_rules [ 1060.073328] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df2a8892-05ec-4200-8b30-e8813181f4e5 with Priority: HIGHEST for action security_group_members [ 1060.073328] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 179ff8c1-53f9-4484-9dce-1fd85174d71d with Priority: HIGHEST for action port [ 1060.073693] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df2a8892-05ec-4200-8b30-e8813181f4e5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.073767] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df2a8892-05ec-4200-8b30-e8813181f4e5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.073843] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df2a8892-05ec-4200-8b30-e8813181f4e5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.079072] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df2a8892-05ec-4200-8b30-e8813181f4e5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.079220] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df2a8892-05ec-4200-8b30-e8813181f4e5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.080132] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-df2a8892-05ec-4200-8b30-e8813181f4e5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.080261] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df2a8892-05ec-4200-8b30-e8813181f4e5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.080328] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df2a8892-05ec-4200-8b30-e8813181f4e5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.080517] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df2a8892-05ec-4200-8b30-e8813181f4e5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.080790] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.080790] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.080912] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.080946] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.081236] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.081236] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df2a8892-05ec-4200-8b30-e8813181f4e5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.084313] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-179ff8c1-53f9-4484-9dce-1fd85174d71d taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.084429] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-179ff8c1-53f9-4484-9dce-1fd85174d71d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.084498] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-179ff8c1-53f9-4484-9dce-1fd85174d71d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.084660] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-179ff8c1-53f9-4484-9dce-1fd85174d71d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.084759] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('179ff8c1-53f9-4484-9dce-1fd85174d71d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.086025] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.142768] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-250 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.143087] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-250" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.143632] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-250" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.143962] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-250" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.144270] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.144455] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.144575] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.144848] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.145039] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.145278] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1060.145400] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1060.146437] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1060.146585] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1060.146718] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1060.146848] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1060.146990] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1060.167283] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1060.167518] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1060.167691] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1060.167897] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-250" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.168282] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-1b623703-5d19-4e24-b8aa-5b76192f92f5 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.168519] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-1b623703-5d19-4e24-b8aa-5b76192f92f5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.168673] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-1b623703-5d19-4e24-b8aa-5b76192f92f5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.169029] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-1b623703-5d19-4e24-b8aa-5b76192f92f5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.169231] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b623703-5d19-4e24-b8aa-5b76192f92f5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.319299] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb3e5499-be65-479e-916c-2fb08083e417 in Status: SUCCESS [ 1060.319570] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.320148] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.320373] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.320551] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.320764] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.320764] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.320875] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.320951] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.321173] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb3e5499-be65-479e-916c-2fb08083e417',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.472222] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4d87c55-80bd-46c8-8078-256c25d0bf4b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.473126] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.473126] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.473126] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.473126] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.473126] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.473126] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.473398] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.473398] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.473398] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.473509] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4d87c55-80bd-46c8-8078-256c25d0bf4b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.473581] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.473642] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.473783] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.473918] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.474016] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.474084] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.474611] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.474611] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.474611] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.474611] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4d87c55-80bd-46c8-8078-256c25d0bf4b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.591890] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-df2a8892-05ec-4200-8b30-e8813181f4e5 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.591890] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df2a8892-05ec-4200-8b30-e8813181f4e5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.591890] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df2a8892-05ec-4200-8b30-e8813181f4e5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.591890] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 179ff8c1-53f9-4484-9dce-1fd85174d71d with status ACTIVE [ 1060.591890] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.591890] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.591890] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.591890] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.591890] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.591890] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.591890] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.591890] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.591890] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.595160] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.595376] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.595481] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.598524] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.598524] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.598524] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.598524] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 179ff8c1-53f9-4484-9dce-1fd85174d71d is going to be updated. [ 1060.598524] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.617491] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.617491] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.617491] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.617491] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.617491] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.617807] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-179ff8c1-53f9-4484-9dce-1fd85174d71d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.671172] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.671485] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.671626] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.671904] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.673896] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.673896] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 1b623703-5d19-4e24-b8aa-5b76192f92f5 not found, creating... [ 1060.674013] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.674279] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.674354] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.674540] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.674687] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.675206] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.675349] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.675597] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.675848] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.676009] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.676161] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 1b623703-5d19-4e24-b8aa-5b76192f92f5 is going to be created. [ 1060.702951] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.702951] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.702951] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.703122] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.703895] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.704180] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-1b623703-5d19-4e24-b8aa-5b76192f92f5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.823485] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb3e5499-be65-479e-916c-2fb08083e417',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.896109] env[70013]: INFO networking_nsxv3.common.synchronization [req-e0ed91f8-c8f1-4bc3-bf46-763d90361de3 req-9a95fc69-a9d5-4fe3-99b2-4e5c2e9e8ab3 tempest-AttachInterfacesUnderV243Test-760224301 tempest-AttachInterfacesUnderV243Test-760224301-project-member] Enqueued Resource ID: bb3e5499-be65-479e-916c-2fb08083e417 with Priority: HIGHEST for action security_group_members [ 1060.896639] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb3e5499-be65-479e-916c-2fb08083e417 with Priority: HIGHEST for action security_group_members [ 1060.897011] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb3e5499-be65-479e-916c-2fb08083e417 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.898065] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.929581] env[70013]: INFO networking_nsxv3.common.synchronization [req-e0ed91f8-c8f1-4bc3-bf46-763d90361de3 req-9a95fc69-a9d5-4fe3-99b2-4e5c2e9e8ab3 tempest-AttachInterfacesUnderV243Test-760224301 tempest-AttachInterfacesUnderV243Test-760224301-project-member] Enqueued Resource ID: bb3e5499-be65-479e-916c-2fb08083e417 with Priority: HIGHEST for action security_group_rules [ 1060.929581] env[70013]: INFO networking_nsxv3.common.synchronization [req-e0ed91f8-c8f1-4bc3-bf46-763d90361de3 req-9a95fc69-a9d5-4fe3-99b2-4e5c2e9e8ab3 tempest-AttachInterfacesUnderV243Test-760224301 tempest-AttachInterfacesUnderV243Test-760224301-project-member] Enqueued Resource ID: bb3e5499-be65-479e-916c-2fb08083e417 with Priority: HIGHEST for action security_group_members [ 1060.929827] env[70013]: INFO networking_nsxv3.common.synchronization [req-e0ed91f8-c8f1-4bc3-bf46-763d90361de3 req-9a95fc69-a9d5-4fe3-99b2-4e5c2e9e8ab3 tempest-AttachInterfacesUnderV243Test-760224301 tempest-AttachInterfacesUnderV243Test-760224301-project-member] Enqueued Resource ID: 92b2e42f-1b28-4c86-a59d-e06f2adc11da with Priority: HIGHEST for action port [ 1060.930430] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb3e5499-be65-479e-916c-2fb08083e417 with Priority: HIGHEST for action security_group_rules [ 1060.930574] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb3e5499-be65-479e-916c-2fb08083e417 with Priority: HIGHEST for action security_group_members [ 1060.930669] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92b2e42f-1b28-4c86-a59d-e06f2adc11da with Priority: HIGHEST for action port [ 1060.930946] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb3e5499-be65-479e-916c-2fb08083e417 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.931380] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.931940] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb3e5499-be65-479e-916c-2fb08083e417 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.932050] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.932253] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-92b2e42f-1b28-4c86-a59d-e06f2adc11da taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.932471] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92b2e42f-1b28-4c86-a59d-e06f2adc11da" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.932541] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92b2e42f-1b28-4c86-a59d-e06f2adc11da" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.932747] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92b2e42f-1b28-4c86-a59d-e06f2adc11da" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.932832] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92b2e42f-1b28-4c86-a59d-e06f2adc11da',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.980223] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4d87c55-80bd-46c8-8078-256c25d0bf4b: rpc.has_security_group_logging(os_id): False [ 1060.998651] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.998651] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.998651] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.998888] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.998888] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.999917] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.999917] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.999917] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.999917] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.999917] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.000267] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.000351] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.000515] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.000638] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.000741] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.000982] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.001124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.001246] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.001382] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.001476] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.001591] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4d87c55-80bd-46c8-8078-256c25d0bf4b is going to be created. [ 1061.077678] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.077678] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.077678] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.079025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.079025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.096051] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4d87c55-80bd-46c8-8078-256c25d0bf4b in Status: IN_PROGRESS for 2s [ 1061.098684] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df2a8892-05ec-4200-8b30-e8813181f4e5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.100281] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.100537] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.100684] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.100998] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.101153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.101338] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a is going to be updated. [ 1061.143703] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.143985] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.144185] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.144257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.144411] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.154464] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: IN_PROGRESS for 2s [ 1061.328539] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb3e5499-be65-479e-916c-2fb08083e417',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.434987] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 92b2e42f-1b28-4c86-a59d-e06f2adc11da with status ACTIVE [ 1061.435241] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.439023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.439023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.439023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.439023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.439023] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.439023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.439023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.439023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.439023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.439023] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.439023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.439023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.439023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.439023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.439023] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 92b2e42f-1b28-4c86-a59d-e06f2adc11da is going to be updated. [ 1061.459124] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.459509] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.459595] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.459817] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.460016] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.460211] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92b2e42f-1b28-4c86-a59d-e06f2adc11da" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.608305] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.608305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.608305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.608683] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.608683] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.608683] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df2a8892-05ec-4200-8b30-e8813181f4e5 is going to be created. [ 1061.611648] env[70013]: INFO networking_nsxv3.common.synchronization [req-8f2e9acf-52ca-41f2-abfb-11791fe2976c req-743b6a44-69ff-419d-a235-509aee505792 service nova] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_rules [ 1061.611854] env[70013]: INFO networking_nsxv3.common.synchronization [req-8f2e9acf-52ca-41f2-abfb-11791fe2976c req-743b6a44-69ff-419d-a235-509aee505792 service nova] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 1061.612016] env[70013]: INFO networking_nsxv3.common.synchronization [req-8f2e9acf-52ca-41f2-abfb-11791fe2976c req-743b6a44-69ff-419d-a235-509aee505792 service nova] Enqueued Resource ID: 1b623703-5d19-4e24-b8aa-5b76192f92f5 with Priority: HIGHEST for action port [ 1061.612530] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_rules [ 1061.612756] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 1061.612756] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b623703-5d19-4e24-b8aa-5b76192f92f5 with Priority: HIGHEST for action port [ 1061.613440] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.613565] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.613632] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.613839] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.613943] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.614944] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.615069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.615676] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b623703-5d19-4e24-b8aa-5b76192f92f5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.615792] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b623703-5d19-4e24-b8aa-5b76192f92f5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.615860] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b623703-5d19-4e24-b8aa-5b76192f92f5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.616206] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b623703-5d19-4e24-b8aa-5b76192f92f5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.616206] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b623703-5d19-4e24-b8aa-5b76192f92f5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.640315] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.641351] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.641458] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.641667] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.641826] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.651147] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df2a8892-05ec-4200-8b30-e8813181f4e5 in Status: UNINITIALIZED for 2s [ 1061.764151] env[70013]: INFO networking_nsxv3.common.synchronization [None req-0d44e182-d409-46b7-aa81-06c755ad4fa5 None None] Enqueued Resource ID: abdba692-cd99-4644-9a5e-c396e764834f with Priority: HIGHEST for action port [ 1061.764151] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abdba692-cd99-4644-9a5e-c396e764834f with Priority: HIGHEST for action port [ 1061.764385] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-abdba692-cd99-4644-9a5e-c396e764834f taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.764513] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abdba692-cd99-4644-9a5e-c396e764834f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.764597] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abdba692-cd99-4644-9a5e-c396e764834f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.765632] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abdba692-cd99-4644-9a5e-c396e764834f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.767198] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abdba692-cd99-4644-9a5e-c396e764834f',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.833093] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.833275] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.833536] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.833618] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.835464] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.835464] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb3e5499-be65-479e-916c-2fb08083e417 is going to be updated. [ 1061.863348] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.863348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.863348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.863348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.863348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.871438] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb3e5499-be65-479e-916c-2fb08083e417 in Status: IN_PROGRESS for 2s [ 1062.078312] env[70013]: INFO networking_nsxv3.common.synchronization [None req-a02b9743-b872-4c99-8c43-1e1f97062ab2 None None] Enqueued Resource ID: 0961aae5-7fd6-40d3-9b45-84c59c937bf3 with Priority: HIGHEST for action port [ 1062.078568] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0961aae5-7fd6-40d3-9b45-84c59c937bf3 with Priority: HIGHEST for action port [ 1062.079129] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-0961aae5-7fd6-40d3-9b45-84c59c937bf3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.079253] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0961aae5-7fd6-40d3-9b45-84c59c937bf3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.079317] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0961aae5-7fd6-40d3-9b45-84c59c937bf3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.079615] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0961aae5-7fd6-40d3-9b45-84c59c937bf3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.079723] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0961aae5-7fd6-40d3-9b45-84c59c937bf3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.118560] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.118764] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.119136] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b623703-5d19-4e24-b8aa-5b76192f92f5 with status ACTIVE [ 1062.119136] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.119237] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.119237] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.119495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.119495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.119657] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.119796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.119858] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.120032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.120117] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.120395] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.120395] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.120500] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.120578] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.120650] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.120733] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b623703-5d19-4e24-b8aa-5b76192f92f5 is going to be updated. [ 1062.153236] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.153374] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.153374] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.153598] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.153752] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.153907] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b623703-5d19-4e24-b8aa-5b76192f92f5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.231620] env[70013]: INFO networking_nsxv3.common.synchronization [req-b2d42d26-bf2f-4611-85e2-9f55c816b602 req-cc744c31-b80f-4647-b2d7-951997c14e10 tempest-ServerActionsTestOtherA-108106573 tempest-ServerActionsTestOtherA-108106573-project-member] Enqueued Resource ID: e555b24f-3b58-40b7-8837-06aac9343ba3 with Priority: HIGHEST for action security_group_members [ 1062.232247] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e555b24f-3b58-40b7-8837-06aac9343ba3 with Priority: HIGHEST for action security_group_members [ 1062.232604] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-e555b24f-3b58-40b7-8837-06aac9343ba3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.232804] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e555b24f-3b58-40b7-8837-06aac9343ba3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.232962] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e555b24f-3b58-40b7-8837-06aac9343ba3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.234591] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e555b24f-3b58-40b7-8837-06aac9343ba3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.234841] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.234976] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.235346] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.235346] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.235346] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.235492] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e555b24f-3b58-40b7-8837-06aac9343ba3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.268754] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port abdba692-cd99-4644-9a5e-c396e764834f [ 1062.268969] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.269114] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.269178] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.269388] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.269475] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.269567] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:abdba692-cd99-4644-9a5e-c396e764834f already deleted. [ 1062.269646] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abdba692-cd99-4644-9a5e-c396e764834f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.587177] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0961aae5-7fd6-40d3-9b45-84c59c937bf3 [ 1062.587472] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.587679] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.587816] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.588115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.588227] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.588334] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0961aae5-7fd6-40d3-9b45-84c59c937bf3 already deleted. [ 1062.588444] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0961aae5-7fd6-40d3-9b45-84c59c937bf3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.739300] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.742133] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.742133] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.742133] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.742133] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.742133] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.742133] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.742133] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.742133] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.742133] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.742133] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e555b24f-3b58-40b7-8837-06aac9343ba3 already deleted. [ 1062.742133] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e555b24f-3b58-40b7-8837-06aac9343ba3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.107645] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4d87c55-80bd-46c8-8078-256c25d0bf4b in Status: SUCCESS [ 1063.107993] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.138595] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.138811] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-353" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.138941] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-353" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.139311] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-353" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.139539] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.139709] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.139941] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.140478] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.140671] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.140894] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1063.141265] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1063.141265] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1063.141265] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1063.141419] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1063.143114] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1063.143114] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1063.164829] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1063.164829] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1063.164829] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1063.165105] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-353" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.166823] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-8e1b8b9c-b1c2-448e-8d9c-621c1810194a taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.166823] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-8e1b8b9c-b1c2-448e-8d9c-621c1810194a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.166823] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-8e1b8b9c-b1c2-448e-8d9c-621c1810194a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.166823] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-8e1b8b9c-b1c2-448e-8d9c-621c1810194a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.166823] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e1b8b9c-b1c2-448e-8d9c-621c1810194a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.168117] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: SUCCESS [ 1063.168538] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.168538] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.168690] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.168827] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.168935] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.169145] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.169206] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.170322] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.170322] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.663430] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df2a8892-05ec-4200-8b30-e8813181f4e5 in Status: SUCCESS [ 1063.663702] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df2a8892-05ec-4200-8b30-e8813181f4e5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.663894] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df2a8892-05ec-4200-8b30-e8813181f4e5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.664140] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df2a8892-05ec-4200-8b30-e8813181f4e5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.664525] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.664525] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.664615] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.664823] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.664947] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.665017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df2a8892-05ec-4200-8b30-e8813181f4e5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.665139] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df2a8892-05ec-4200-8b30-e8813181f4e5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.674384] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.676543] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.676543] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.676750] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.676863] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.677027] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.677193] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 8e1b8b9c-b1c2-448e-8d9c-621c1810194a not found, creating... [ 1063.677461] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.677633] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.677778] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.678030] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.678239] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.678492] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.678919] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.678919] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.679130] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.679283] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.679433] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 8e1b8b9c-b1c2-448e-8d9c-621c1810194a is going to be created. [ 1063.713603] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.713881] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.714014] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.715532] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.715532] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.715532] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-8e1b8b9c-b1c2-448e-8d9c-621c1810194a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.888025] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb3e5499-be65-479e-916c-2fb08083e417 in Status: SUCCESS [ 1063.888025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.888025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.888025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.888025] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.888025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.888025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.888025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.888025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.888025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.888025] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bb3e5499-be65-479e-916c-2fb08083e417',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.888827] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.889094] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.889409] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.889537] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.889603] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.889796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.889886] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.889936] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb3e5499-be65-479e-916c-2fb08083e417',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.167322] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df2a8892-05ec-4200-8b30-e8813181f4e5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.181513] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.396025] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb3e5499-be65-479e-916c-2fb08083e417',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.396614] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bb3e5499-be65-479e-916c-2fb08083e417',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.491255] env[70013]: INFO networking_nsxv3.common.synchronization [req-b2d42d26-bf2f-4611-85e2-9f55c816b602 req-fb7ce022-a2fa-4c13-ad2f-5a7813171f46 service nova] Enqueued Resource ID: e555b24f-3b58-40b7-8837-06aac9343ba3 with Priority: HIGHEST for action security_group_rules [ 1064.491255] env[70013]: INFO networking_nsxv3.common.synchronization [req-b2d42d26-bf2f-4611-85e2-9f55c816b602 req-fb7ce022-a2fa-4c13-ad2f-5a7813171f46 service nova] Enqueued Resource ID: e555b24f-3b58-40b7-8837-06aac9343ba3 with Priority: HIGHEST for action security_group_members [ 1064.491255] env[70013]: INFO networking_nsxv3.common.synchronization [req-b2d42d26-bf2f-4611-85e2-9f55c816b602 req-fb7ce022-a2fa-4c13-ad2f-5a7813171f46 service nova] Enqueued Resource ID: 8e1b8b9c-b1c2-448e-8d9c-621c1810194a with Priority: HIGHEST for action port [ 1064.492388] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e555b24f-3b58-40b7-8837-06aac9343ba3 with Priority: HIGHEST for action security_group_rules [ 1064.492729] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e555b24f-3b58-40b7-8837-06aac9343ba3 with Priority: HIGHEST for action security_group_members [ 1064.492970] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e1b8b9c-b1c2-448e-8d9c-621c1810194a with Priority: HIGHEST for action port [ 1064.494296] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e555b24f-3b58-40b7-8837-06aac9343ba3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.494367] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e555b24f-3b58-40b7-8837-06aac9343ba3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.494597] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e555b24f-3b58-40b7-8837-06aac9343ba3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.494663] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e555b24f-3b58-40b7-8837-06aac9343ba3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.494784] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e555b24f-3b58-40b7-8837-06aac9343ba3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.496045] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-e555b24f-3b58-40b7-8837-06aac9343ba3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.496175] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e555b24f-3b58-40b7-8837-06aac9343ba3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.496234] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e555b24f-3b58-40b7-8837-06aac9343ba3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.496428] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e555b24f-3b58-40b7-8837-06aac9343ba3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.496616] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.497385] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.497385] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.497385] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.497385] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.497385] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e555b24f-3b58-40b7-8837-06aac9343ba3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.501233] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e1b8b9c-b1c2-448e-8d9c-621c1810194a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.501360] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e1b8b9c-b1c2-448e-8d9c-621c1810194a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.501399] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e1b8b9c-b1c2-448e-8d9c-621c1810194a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.501604] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e1b8b9c-b1c2-448e-8d9c-621c1810194a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.501678] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e1b8b9c-b1c2-448e-8d9c-621c1810194a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.504127] env[70013]: INFO networking_nsxv3.common.synchronization [None req-6710290b-663b-46c0-841f-4e556d2187f5 None None] Enqueued Resource ID: 29886c5b-7efb-42f6-84c0-813f60463b68 with Priority: HIGHEST for action port [ 1064.504547] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29886c5b-7efb-42f6-84c0-813f60463b68 with Priority: HIGHEST for action port [ 1064.505141] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-29886c5b-7efb-42f6-84c0-813f60463b68 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.505268] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29886c5b-7efb-42f6-84c0-813f60463b68" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.505338] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29886c5b-7efb-42f6-84c0-813f60463b68" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.505617] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29886c5b-7efb-42f6-84c0-813f60463b68" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.505662] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29886c5b-7efb-42f6-84c0-813f60463b68',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.671493] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df2a8892-05ec-4200-8b30-e8813181f4e5: rpc.has_security_group_logging(os_id): False [ 1064.687026] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.687026] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.687026] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.687026] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.687026] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.687026] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a is going to be updated. [ 1064.688090] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.688474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.688689] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.689032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.689275] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.691634] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.691634] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.691634] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.691634] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.691634] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.691634] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df2a8892-05ec-4200-8b30-e8813181f4e5 is going to be created. [ 1064.716264] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.716264] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.716264] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.716264] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.716264] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.724266] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: IN_PROGRESS for 2s [ 1064.747907] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.750076] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.750076] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.750076] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.750076] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.760182] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df2a8892-05ec-4200-8b30-e8813181f4e5 in Status: IN_PROGRESS for 2s [ 1064.881853] env[70013]: INFO networking_nsxv3.common.synchronization [req-6e9a3a1f-c2ef-4dc1-98eb-e8e9c25236b2 req-c749c493-7caf-4033-b836-d404d5ab86e6 tempest-ServerDiskConfigTestJSON-536876121 tempest-ServerDiskConfigTestJSON-536876121-project-member] Enqueued Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1064.881853] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1064.881853] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.881853] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.881853] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.881853] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.881853] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.881853] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.881853] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.881853] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.881853] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.881853] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.899461] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb3e5499-be65-479e-916c-2fb08083e417',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.899461] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bb3e5499-be65-479e-916c-2fb08083e417: rpc.has_security_group_logging(os_id): False [ 1064.919227] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.919355] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.919517] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.919639] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.919731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.919974] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.920408] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.920408] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.920408] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.920408] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.920539] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb3e5499-be65-479e-916c-2fb08083e417 is going to be updated. [ 1064.988094] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.988094] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.988094] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.988094] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.988094] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.000779] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb3e5499-be65-479e-916c-2fb08083e417 in Status: IN_PROGRESS for 2s [ 1065.003313] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e555b24f-3b58-40b7-8837-06aac9343ba3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.004409] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-e555b24f-3b58-40b7-8837-06aac9343ba3 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.004663] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e555b24f-3b58-40b7-8837-06aac9343ba3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.005134] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e1b8b9c-b1c2-448e-8d9c-621c1810194a with status ACTIVE [ 1065.007034] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.007034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.007034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.007034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.007034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.007034] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.007034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.007034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.007034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.007034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.007034] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.007034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.007034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.007034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.007034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.007627] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e1b8b9c-b1c2-448e-8d9c-621c1810194a is going to be updated. [ 1065.008825] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29886c5b-7efb-42f6-84c0-813f60463b68 [ 1065.009097] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.009311] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.009453] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.009672] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.009866] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.010049] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29886c5b-7efb-42f6-84c0-813f60463b68 already deleted. [ 1065.010218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29886c5b-7efb-42f6-84c0-813f60463b68" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.133543] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.133543] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.133543] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.133543] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.133543] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.133543] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e1b8b9c-b1c2-448e-8d9c-621c1810194a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.383586] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.383763] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.383763] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.383974] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.384084] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.384285] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.384406] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.384448] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.384597] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.384673] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.384805] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f8a4673-59c5-493b-8250-617958bf996b is going to be updated. [ 1065.401904] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.402127] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.402193] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.402411] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.402503] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.402615] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb3e5499-be65-479e-916c-2fb08083e417 is going to be updated. [ 1065.422403] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.422577] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.422721] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.422995] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.426029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.441086] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.441086] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.441086] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.441086] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.441086] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.441086] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: IN_PROGRESS for 2s [ 1065.448357] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb3e5499-be65-479e-916c-2fb08083e417 in Status: IN_PROGRESS for 2s [ 1065.506274] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e555b24f-3b58-40b7-8837-06aac9343ba3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.901352] env[70013]: INFO networking_nsxv3.common.synchronization [req-91c61070-b4f1-44bf-9ee8-5a979ec3056d req-f8bb9194-743f-440f-b41c-fc3853111fce tempest-AttachInterfacesUnderV243Test-760224301 tempest-AttachInterfacesUnderV243Test-760224301-project-member] Enqueued Resource ID: bb3e5499-be65-479e-916c-2fb08083e417 with Priority: HIGHEST for action security_group_members [ 1065.901352] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb3e5499-be65-479e-916c-2fb08083e417 with Priority: HIGHEST for action security_group_members [ 1065.901352] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb3e5499-be65-479e-916c-2fb08083e417 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.901352] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.012399] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.012399] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.012399] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.012399] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.012399] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.012399] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e555b24f-3b58-40b7-8837-06aac9343ba3 is going to be created. [ 1066.039719] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.039719] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.039719] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.039719] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.039719] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.051309] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e555b24f-3b58-40b7-8837-06aac9343ba3 in Status: UNINITIALIZED for 2s [ 1066.735269] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: SUCCESS [ 1066.736331] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.736331] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.736331] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.736331] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.736331] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.736331] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.736714] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.736714] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.736714] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.736714] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.777965] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df2a8892-05ec-4200-8b30-e8813181f4e5 in Status: SUCCESS [ 1066.779608] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df2a8892-05ec-4200-8b30-e8813181f4e5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.018836] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb3e5499-be65-479e-916c-2fb08083e417 in Status: SUCCESS [ 1067.019205] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.019333] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.019518] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.019610] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb3e5499-be65-479e-916c-2fb08083e417',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.243689] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.243689] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.243689] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.244101] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.244101] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.244176] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.244267] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.244510] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.244541] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.244627] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.244863] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.244963] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.245071] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.245269] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.245428] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.245537] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.245608] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.245774] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.245867] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.245982] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.250859] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.451171] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: SUCCESS [ 1067.451374] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f8a4673-59c5-493b-8250-617958bf996b deletion is rescheduled due to dependency. [ 1067.451539] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.457414] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb3e5499-be65-479e-916c-2fb08083e417 in Status: SUCCESS [ 1067.457781] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.457922] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.458212] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.458725] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.458725] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.458725] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.458942] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.459029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.459148] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb3e5499-be65-479e-916c-2fb08083e417',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.542492] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.542704] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.542777] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.542980] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.543131] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.543242] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb3e5499-be65-479e-916c-2fb08083e417 is going to be deleted. [ 1067.620577] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.620577] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.620577] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.620775] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.620872] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.620997] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.753229] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f422a68f-f64a-4d93-9deb-289ae02aea3a: rpc.has_security_group_logging(os_id): False [ 1067.776733] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.776822] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.776863] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.777118] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.777217] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.777476] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.777582] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.777649] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.777806] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.777886] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.778080] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.778183] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.778319] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.778452] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.778531] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.778727] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.778822] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.778886] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.779550] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.779550] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.779550] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a is going to be updated. [ 1067.780370] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.780500] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.780545] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.781014] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.781014] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.858977] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.858977] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.859148] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.859274] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.859479] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.879016] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: IN_PROGRESS for 2s [ 1067.961587] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.961587] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.961587] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.964022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.964022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.964022] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.964022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.964022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.964022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.964022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.964022] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb3e5499-be65-479e-916c-2fb08083e417 is going to be deleted. [ 1068.019682] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.019980] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.019980] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.020246] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.020246] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.020332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.020474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.020626] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.020811] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.020941] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.020941] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.021112] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.023017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.023017] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb3e5499-be65-479e-916c-2fb08083e417',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.065920] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e555b24f-3b58-40b7-8837-06aac9343ba3 in Status: SUCCESS [ 1068.065920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e555b24f-3b58-40b7-8837-06aac9343ba3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.065920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e555b24f-3b58-40b7-8837-06aac9343ba3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.065920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e555b24f-3b58-40b7-8837-06aac9343ba3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.065920] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.065920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.065920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.065920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.065920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.065920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e555b24f-3b58-40b7-8837-06aac9343ba3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.065920] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e555b24f-3b58-40b7-8837-06aac9343ba3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.283462] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.524846] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.524846] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.524846] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.524846] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.524846] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.524846] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.524846] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.524846] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.525308] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.525308] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.525308] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb3e5499-be65-479e-916c-2fb08083e417 already deleted. [ 1068.525403] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb3e5499-be65-479e-916c-2fb08083e417" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.568434] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e555b24f-3b58-40b7-8837-06aac9343ba3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.785207] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.071774] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e555b24f-3b58-40b7-8837-06aac9343ba3: rpc.has_security_group_logging(os_id): False [ 1069.088829] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.089077] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.089153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.089423] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.089558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.089856] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.090018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.090117] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.090573] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.090700] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.091274] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e555b24f-3b58-40b7-8837-06aac9343ba3 is going to be created. [ 1069.151772] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.151927] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.152014] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.152229] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.152417] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.164047] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e555b24f-3b58-40b7-8837-06aac9343ba3 in Status: IN_PROGRESS for 2s [ 1069.287659] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1069.287794] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1069.641272] env[70013]: INFO networking_nsxv3.common.synchronization [None req-f443d082-1d76-425f-9ef1-0a3031d9d2c6 tempest-ServerRescueNegativeTestJSON-1808745105 tempest-ServerRescueNegativeTestJSON-1808745105-project-member] Enqueued Resource ID: 250f9011-1d0c-4c88-9907-8d448831417a with Priority: HIGHEST for action security_group_rules [ 1069.641272] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250f9011-1d0c-4c88-9907-8d448831417a with Priority: HIGHEST for action security_group_rules [ 1069.641272] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-250f9011-1d0c-4c88-9907-8d448831417a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.641272] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.641272] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.641488] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.642095] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('250f9011-1d0c-4c88-9907-8d448831417a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.768625] env[70013]: INFO networking_nsxv3.common.synchronization [None req-4294dd6a-bc17-47ed-b327-318b19e10f00 tempest-ServerRescueNegativeTestJSON-1808745105 tempest-ServerRescueNegativeTestJSON-1808745105-project-member] Enqueued Resource ID: 250f9011-1d0c-4c88-9907-8d448831417a with Priority: HIGHEST for action security_group_rules [ 1069.771084] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250f9011-1d0c-4c88-9907-8d448831417a with Priority: HIGHEST for action security_group_rules [ 1069.771084] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-250f9011-1d0c-4c88-9907-8d448831417a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.771084] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.894315] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: SUCCESS [ 1069.895172] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.064334] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.064334] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.064334] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.064334] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.079818] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1070.083866] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.085660] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1070.120384] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.120835] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.120931] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.121549] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.136260] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.136874] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1070.137022] env[70013]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70013) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1070.137167] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1070.159251] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.159390] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.159784] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.160928] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.160928] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.160928] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 250f9011-1d0c-4c88-9907-8d448831417a already deleted. [ 1070.160928] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.160928] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.160928] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.161205] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('250f9011-1d0c-4c88-9907-8d448831417a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.234131] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.234376] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.234548] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.234909] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.236527] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.236819] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1070.317103] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.317329] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.317407] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.317639] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.317939] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.318733] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1070.391362] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.391528] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.391621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.391877] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.392215] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.392500] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1070.392599] env[70013]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'1197cb6b-f6f8-4e0a-8b93-e11877f2e915', '16c877e7-f731-49a5-b994-7d74c36c464b', '35104466-92f1-4e6a-9df0-55e3f828079c', '9772853b-4ff5-4a28-8f4f-b2e864434ff9', 'cf5314a2-236c-4f4a-b8ea-d899149c1ea8', '9b51e70d-5edb-4332-99e9-eb53e6015365', 'e4d87c55-80bd-46c8-8078-256c25d0bf4b', '5d0cfefe-0851-47aa-9a55-0d92164acbc1', 'cff04b9a-dfb1-4bca-9a12-21566cf5fe37', 'bc1b714b-7da7-41dc-b21f-d8ad167c33d9', '1f3400e9-8b30-4b29-bde9-85cf198cabf0', 'fb27dbe1-6f26-411f-bcfc-69daca38eb24', '0e60d03d-8d54-4827-87a6-1c1728f166fe', '6f8a4673-59c5-493b-8250-617958bf996b', 'd47d19df-e406-4c01-9cf0-1110c7c55440', 'a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2', '33eb23fb-1e54-4510-ba50-bf9c982207a3', 'f3b902d5-ffa1-4a45-b449-3b726cf76855', '0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd', 'f43167c6-5d75-4a22-ac5d-d671524fba53', '5333cddc-c089-40b3-9eba-dc3f40477cac', 'a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748', '572a619a-3a59-46a6-bc09-5d754276356e', 'd189cef5-279a-45d3-a52a-a0fb084ee3fa', '0baaf456-ebe4-4944-a9c9-d343bf8ebd98', '0d98818b-c2c5-4242-8897-fe65d03027a5', '73383895-5111-42cc-a071-b2512b2f23af', '16fadac6-f5a2-4997-b67b-221b3b4e45a8', 'ca27a1b0-973f-4958-8f7f-a5c216cb9a8c', 'ff280f19-627b-45ca-afac-7d9154581e89', '0776053c-3635-4232-86b2-1a586b64e542', '0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6', '7a9726c0-7c30-4b11-81a1-9a9fcc702273', '667765ac-1a17-4f77-a3e3-a4d9d12ca600', '6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5', '86efc288-b26f-4298-9444-58202b5c40d5', 'd1b8da2b-4abc-407f-9635-008e18b53627', '12839468-1e74-4c74-abf4-73e096a46e61', 'f422a68f-f64a-4d93-9deb-289ae02aea3a', '2c2da01b-6452-4ea7-a1ca-fac9de38da7b', 'f6998667-5e88-456a-b064-7faf8fc4bfd8', 'e555b24f-3b58-40b7-8837-06aac9343ba3', '48314c78-ef82-4312-9437-4a43cc3de63d', 'e99a11c8-f108-4784-aa19-9139eb46ce97', '5a7abade-e912-4196-b558-4a6d4ece9b29', 'df2a8892-05ec-4200-8b30-e8813181f4e5'} {{(pid=70013) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1070.392692] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1070.413742] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.413897] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.413942] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.414671] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.414671] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.414671] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1070.414671] env[70013]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70013) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1070.414671] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1070.492805] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.492805] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.492805] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.492805] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.494272] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.494272] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1070.494344] env[70013]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70013) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1070.494391] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1070.495124] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1070.495124] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/46 resources of Type:Security Group Rules [ 1070.495124] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 with Priority: HIGH for action security_group_rules [ 1070.495124] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGH for action security_group_rules [ 1070.495124] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 35104466-92f1-4e6a-9df0-55e3f828079c with Priority: HIGH for action security_group_rules [ 1070.495283] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9772853b-4ff5-4a28-8f4f-b2e864434ff9 with Priority: HIGH for action security_group_rules [ 1070.495349] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 with Priority: HIGH for action security_group_rules [ 1070.495429] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 with Priority: HIGH for action security_group_rules [ 1070.495495] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e4d87c55-80bd-46c8-8078-256c25d0bf4b with Priority: HIGH for action security_group_rules [ 1070.495559] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 with Priority: HIGH for action security_group_rules [ 1070.495632] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 with Priority: HIGH for action security_group_rules [ 1070.495696] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGH for action security_group_rules [ 1070.495793] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 with Priority: HIGH for action security_group_rules [ 1070.495843] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 with Priority: HIGH for action security_group_rules [ 1070.495876] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0e60d03d-8d54-4827-87a6-1c1728f166fe with Priority: HIGH for action security_group_rules [ 1070.495927] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGH for action security_group_rules [ 1070.495987] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGH for action security_group_rules [ 1070.496063] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 with Priority: HIGH for action security_group_rules [ 1070.496128] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 33eb23fb-1e54-4510-ba50-bf9c982207a3 with Priority: HIGH for action security_group_rules [ 1070.496191] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f3b902d5-ffa1-4a45-b449-3b726cf76855 with Priority: HIGH for action security_group_rules [ 1070.496253] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd with Priority: HIGH for action security_group_rules [ 1070.496315] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f43167c6-5d75-4a22-ac5d-d671524fba53 with Priority: HIGH for action security_group_rules [ 1070.496417] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.647233] env[70013]: INFO networking_nsxv3.common.synchronization [req-d7af7123-688f-405f-8e94-c6e826ac8cd9 req-dde49784-ace0-459f-a21e-d9baf2d0a6cb tempest-ServerTagsTestJSON-601315959 tempest-ServerTagsTestJSON-601315959-project-member] Enqueued Resource ID: e4d87c55-80bd-46c8-8078-256c25d0bf4b with Priority: HIGHEST for action security_group_members [ 1070.647783] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4d87c55-80bd-46c8-8078-256c25d0bf4b with Priority: HIGHEST for action security_group_members [ 1070.648308] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 with Priority: HIGH for action security_group_rules [ 1070.648308] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35104466-92f1-4e6a-9df0-55e3f828079c with Priority: HIGH for action security_group_rules [ 1070.648308] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4d87c55-80bd-46c8-8078-256c25d0bf4b with Priority: HIGH for action security_group_rules [ 1070.648308] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d47d19df-e406-4c01-9cf0-1110c7c55440 with Priority: HIGH for action security_group_rules [ 1070.649017] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f43167c6-5d75-4a22-ac5d-d671524fba53 with Priority: HIGH for action security_group_rules [ 1070.649017] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd with Priority: HIGH for action security_group_rules [ 1070.649017] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3b902d5-ffa1-4a45-b449-3b726cf76855 with Priority: HIGH for action security_group_rules [ 1070.649017] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33eb23fb-1e54-4510-ba50-bf9c982207a3 with Priority: HIGH for action security_group_rules [ 1070.649017] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGH for action security_group_rules [ 1070.649017] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 with Priority: HIGH for action security_group_rules [ 1070.649017] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e60d03d-8d54-4827-87a6-1c1728f166fe with Priority: HIGH for action security_group_rules [ 1070.649017] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 with Priority: HIGH for action security_group_rules [ 1070.649463] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 with Priority: HIGH for action security_group_rules [ 1070.649463] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 with Priority: HIGH for action security_group_rules [ 1070.649538] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 with Priority: HIGH for action security_group_rules [ 1070.651502] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 with Priority: HIGH for action security_group_rules [ 1070.651502] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 with Priority: HIGH for action security_group_rules [ 1070.651502] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 with Priority: HIGH for action security_group_rules [ 1070.651502] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGH for action security_group_rules [ 1070.651502] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9772853b-4ff5-4a28-8f4f-b2e864434ff9 with Priority: HIGH for action security_group_rules [ 1070.651502] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4d87c55-80bd-46c8-8078-256c25d0bf4b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.651502] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.651502] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.651778] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.651778] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.651778] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.651879] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.652406] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.652406] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.652406] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4d87c55-80bd-46c8-8078-256c25d0bf4b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.653582] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1197cb6b-f6f8-4e0a-8b93-e11877f2e915 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.653825] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.653902] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.654422] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.654422] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1197cb6b-f6f8-4e0a-8b93-e11877f2e915',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.655368] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35104466-92f1-4e6a-9df0-55e3f828079c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.655506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.655699] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.655883] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.655968] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35104466-92f1-4e6a-9df0-55e3f828079c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.656720] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4d87c55-80bd-46c8-8078-256c25d0bf4b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.656835] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.656931] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.657248] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.657327] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4d87c55-80bd-46c8-8078-256c25d0bf4b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.658545] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d47d19df-e406-4c01-9cf0-1110c7c55440 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.658662] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.658731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.658891] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.658968] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d47d19df-e406-4c01-9cf0-1110c7c55440',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.660140] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f43167c6-5d75-4a22-ac5d-d671524fba53 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.660280] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.660350] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.660842] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.660842] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f43167c6-5d75-4a22-ac5d-d671524fba53',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.661913] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.662156] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.662228] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.662390] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.662611] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.664373] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3b902d5-ffa1-4a45-b449-3b726cf76855 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.664513] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.664574] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.664762] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.664949] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3b902d5-ffa1-4a45-b449-3b726cf76855',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.665997] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33eb23fb-1e54-4510-ba50-bf9c982207a3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.666185] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.666261] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.666365] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.666428] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33eb23fb-1e54-4510-ba50-bf9c982207a3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.667155] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.667259] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.667324] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.667699] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.667699] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.668338] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.668442] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.668480] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.668633] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.668701] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.673038] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e60d03d-8d54-4827-87a6-1c1728f166fe taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.673038] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.673038] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.673038] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.673038] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e60d03d-8d54-4827-87a6-1c1728f166fe',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.673038] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb27dbe1-6f26-411f-bcfc-69daca38eb24 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.673038] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.673038] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.673038] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.673038] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb27dbe1-6f26-411f-bcfc-69daca38eb24',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.673623] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f3400e9-8b30-4b29-bde9-85cf198cabf0 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.673623] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.674062] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.674340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.674426] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f3400e9-8b30-4b29-bde9-85cf198cabf0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.675965] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.676180] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.676180] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.676327] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.676399] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc1b714b-7da7-41dc-b21f-d8ad167c33d9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.677618] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cff04b9a-dfb1-4bca-9a12-21566cf5fe37 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.677871] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.677944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.678167] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.678260] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cff04b9a-dfb1-4bca-9a12-21566cf5fe37',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.679201] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b51e70d-5edb-4332-99e9-eb53e6015365 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.679355] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.679515] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.679832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.679918] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.681998] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d0cfefe-0851-47aa-9a55-0d92164acbc1 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.682122] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.682230] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.682349] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.682422] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d0cfefe-0851-47aa-9a55-0d92164acbc1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.683696] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf5314a2-236c-4f4a-b8ea-d899149c1ea8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.683696] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.683696] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.683696] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.683696] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf5314a2-236c-4f4a-b8ea-d899149c1ea8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.684583] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.684699] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.684784] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.684977] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.685080] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.685870] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9772853b-4ff5-4a28-8f4f-b2e864434ff9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.685999] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.686075] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.686230] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.686304] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9772853b-4ff5-4a28-8f4f-b2e864434ff9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.715029] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.715029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.715029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.715029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.715029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.715406] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 250f9011-1d0c-4c88-9907-8d448831417a already deleted. [ 1070.715406] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.156628] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.156936] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.156975] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.157248] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.176305] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f3400e9-8b30-4b29-bde9-85cf198cabf0 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.176450] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.176522] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.176729] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.176894] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.176995] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.177097] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.177312] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.177404] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.177497] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.177612] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f3400e9-8b30-4b29-bde9-85cf198cabf0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.186199] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b51e70d-5edb-4332-99e9-eb53e6015365 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.189042] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.189042] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.189042] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.189042] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.189042] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.189042] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.189042] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.189042] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.189042] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.189042] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.190575] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.190720] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.214069] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e555b24f-3b58-40b7-8837-06aac9343ba3 in Status: SUCCESS [ 1071.214540] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e555b24f-3b58-40b7-8837-06aac9343ba3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.216778] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.217029] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.217165] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.217233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.217430] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.217889] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.217889] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4d87c55-80bd-46c8-8078-256c25d0bf4b is going to be updated. [ 1071.221801] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.221910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.222018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.222184] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.223807] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.223924] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.224671] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.224766] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.225654] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.225768] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.227147] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b51e70d-5edb-4332-99e9-eb53e6015365 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.227235] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.227293] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.227462] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.227615] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.227746] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.227808] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.227913] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.227996] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.228092] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.228238] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b51e70d-5edb-4332-99e9-eb53e6015365 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.228327] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.228388] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.228529] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.228662] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.228750] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.228805] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.230243] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.230243] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.230243] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.230243] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.237717] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.237847] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.254034] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.254297] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.271484] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.271643] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.273886] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.273886] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.275332] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.275332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.275584] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.275631] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.276353] env[70013]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1071.276893] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.277293] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.278227] env[70013]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1071.278631] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.278744] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.279593] env[70013]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1071.279979] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.280088] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.280787] env[70013]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1071.281181] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.281310] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f43167c6-5d75-4a22-ac5d-d671524fba53 is going to be deleted. [ 1071.282813] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.282934] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.283018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.283228] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.284647] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.284711] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.285327] env[70013]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1071.285731] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.285817] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.286504] env[70013]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1071.286883] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.286980] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.309127] env[70013]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1071.309826] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.309924] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc1b714b-7da7-41dc-b21f-d8ad167c33d9 is going to be deleted. [ 1071.311037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.311242] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.325239] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.325408] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.325447] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.325649] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.325798] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.337174] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4d87c55-80bd-46c8-8078-256c25d0bf4b in Status: IN_PROGRESS for 2s [ 1071.339478] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.339694] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd is going to be deleted. [ 1071.340661] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.340872] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.358810] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.358810] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.362719] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.362719] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d47d19df-e406-4c01-9cf0-1110c7c55440 is going to be deleted. [ 1071.362961] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.363060] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.385720] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.385877] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1197cb6b-f6f8-4e0a-8b93-e11877f2e915 is going to be deleted. [ 1071.386877] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.387158] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.393543] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.393698] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.419595] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.419595] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.424283] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.424283] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.424283] env[70013]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1071.424948] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.425161] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3b902d5-ffa1-4a45-b449-3b726cf76855 is going to be deleted. [ 1071.426623] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.426718] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.491640] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.491936] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.503883] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.504246] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e60d03d-8d54-4827-87a6-1c1728f166fe is going to be deleted. [ 1071.506416] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.506707] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.538314] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.538609] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2 is going to be deleted. [ 1071.539761] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.540055] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.583643] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.583784] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.584697] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.584808] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 is going to be deleted. [ 1071.585786] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.586061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.627281] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.627419] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.643156] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.643335] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b is going to be deleted. [ 1071.644258] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.644515] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.690680] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f3400e9-8b30-4b29-bde9-85cf198cabf0 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.690680] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.690891] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.690973] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.691143] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.691248] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.691322] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.691562] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.691664] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.691767] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.691907] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f3400e9-8b30-4b29-bde9-85cf198cabf0 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.692009] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.692073] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.692217] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.692356] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.692448] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.692509] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.692645] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.692722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.692803] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.692924] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f3400e9-8b30-4b29-bde9-85cf198cabf0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.703260] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.703798] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.718345] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.718483] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9772853b-4ff5-4a28-8f4f-b2e864434ff9 is going to be deleted. [ 1071.719399] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.719625] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.736634] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b51e70d-5edb-4332-99e9-eb53e6015365: rpc.has_security_group_logging(os_id): False [ 1071.763634] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.763844] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f8a4673-59c5-493b-8250-617958bf996b is going to be deleted. [ 1071.764958] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.765615] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.767715] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.767715] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.768786] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.768939] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.789762] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.789897] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.806400] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.806400] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33eb23fb-1e54-4510-ba50-bf9c982207a3 is going to be deleted. [ 1071.807404] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.807662] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.833257] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.833366] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.844788] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.844788] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35104466-92f1-4e6a-9df0-55e3f828079c is going to be deleted. [ 1071.845807] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.846060] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.908102] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.908305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.927944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.928186] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf5314a2-236c-4f4a-b8ea-d899149c1ea8 is going to be deleted. [ 1071.929501] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.929713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.947529] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.947650] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.983576] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.983759] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb27dbe1-6f26-411f-bcfc-69daca38eb24 is going to be deleted. [ 1071.984737] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.984992] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.985069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.985230] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4d87c55-80bd-46c8-8078-256c25d0bf4b is going to be deleted. [ 1071.986069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.986344] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.990517] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.990697] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.031113] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.031113] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cff04b9a-dfb1-4bca-9a12-21566cf5fe37 is going to be deleted. [ 1072.032398] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.032627] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.032725] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.032858] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f43167c6-5d75-4a22-ac5d-d671524fba53" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.033027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.033204] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.033285] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.033402] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc1b714b-7da7-41dc-b21f-d8ad167c33d9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.034084] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.034208] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.034324] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.034509] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d005c1c-fa68-4dfe-b2f9-ae18afcba4cd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.034917] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.035258] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.035258] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.035455] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d47d19df-e406-4c01-9cf0-1110c7c55440" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.035659] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.035888] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.036038] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.036220] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1197cb6b-f6f8-4e0a-8b93-e11877f2e915" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.036428] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.036650] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.036786] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.036984] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3b902d5-ffa1-4a45-b449-3b726cf76855" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.037217] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.037440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.037784] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.037999] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e60d03d-8d54-4827-87a6-1c1728f166fe" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.038229] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.038461] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.038593] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.038791] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a29db9cc-f75d-48dd-8f3f-b4ace68fa6a2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.039008] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.039253] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.039395] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.039590] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.040042] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.040295] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.040447] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.040633] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.040841] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.041086] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.093377] env[70013]: INFO networking_nsxv3.common.synchronization [req-a4547a75-8fb0-4460-be2b-324223a0ea7c req-2d62ea28-c752-4b61-aec3-f26d19a91dd0 tempest-ServersNegativeTestJSON-128962351 tempest-ServersNegativeTestJSON-128962351-project-member] Enqueued Resource ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 with Priority: HIGHEST for action security_group_members [ 1072.093894] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 with Priority: HIGHEST for action security_group_members [ 1072.094267] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b51e70d-5edb-4332-99e9-eb53e6015365 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.094399] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.094468] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.094661] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.094809] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.094978] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.095153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.095234] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.095321] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.095413] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.101570] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.101795] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.101910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.102050] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.102173] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.102257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.102462] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.102571] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.102649] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.102883] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.102966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.103127] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.103219] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.103269] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.103676] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.103676] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.103676] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 is going to be updated. [ 1072.104895] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.105099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.105196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.105316] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9772853b-4ff5-4a28-8f4f-b2e864434ff9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.105441] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.105656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.105656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.105845] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.105897] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.106083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.106168] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.106272] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33eb23fb-1e54-4510-ba50-bf9c982207a3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.106382] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.106521] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.106613] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.106726] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35104466-92f1-4e6a-9df0-55e3f828079c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.144315] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.144315] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.144315] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.144315] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.144315] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.144315] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf5314a2-236c-4f4a-b8ea-d899149c1ea8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.187368] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.187747] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.187747] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.188320] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.188457] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.188698] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.190146] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.190416] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.190416] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.190666] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.190666] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.190747] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb27dbe1-6f26-411f-bcfc-69daca38eb24" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.195183] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f3400e9-8b30-4b29-bde9-85cf198cabf0: rpc.has_security_group_logging(os_id): False [ 1072.249200] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.249336] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.249532] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.249637] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.273846] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.274025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.314724] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.315117] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.315257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.315317] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.315521] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.315603] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.315790] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.315887] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.315976] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.316133] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.316239] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.316438] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.316520] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.316574] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.316717] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.316794] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.316874] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 is going to be updated. [ 1072.318232] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.318403] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.318489] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.318603] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cff04b9a-dfb1-4bca-9a12-21566cf5fe37" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.345678] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.345885] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.345885] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.346087] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.346235] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.383515] env[70013]: INFO networking_nsxv3.common.synchronization [req-49947e67-928d-488e-af87-c580e4249f8b req-5a41823a-2145-4ebe-afdd-25b5c9ccd222 tempest-ServerRescueTestJSON-1890363448 tempest-ServerRescueTestJSON-1890363448-project-member] Enqueued Resource ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 with Priority: HIGHEST for action security_group_members [ 1072.384063] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 with Priority: HIGHEST for action security_group_members [ 1072.384452] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f6998667-5e88-456a-b064-7faf8fc4bfd8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.384568] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.384643] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.384872] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.385203] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.385321] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.385395] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.385549] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.385637] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.385733] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f6998667-5e88-456a-b064-7faf8fc4bfd8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.435098] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 in Status: IN_PROGRESS for 2s [ 1072.503762] env[70013]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1072.504427] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.504581] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.504695] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.505030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.505185] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.537827] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 in Status: IN_PROGRESS for 2s [ 1072.598133] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.598314] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.598388] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.598717] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.598871] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.599221] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.599346] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.599407] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.599685] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.599819] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.599861] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 is going to be updated. [ 1072.638021] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.638021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.638021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.638021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.638021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.644647] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 in Status: IN_PROGRESS for 2s [ 1072.687289] env[70013]: INFO networking_nsxv3.common.synchronization [None req-56a150e2-f461-4323-bbe9-eeb7d22adf1f tempest-AttachVolumeNegativeTest-680083968 tempest-AttachVolumeNegativeTest-680083968-project-member] Enqueued Resource ID: 9378f72e-568d-4e53-8f92-4547bbc2beb3 with Priority: HIGHEST for action security_group_rules [ 1072.687289] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9378f72e-568d-4e53-8f92-4547bbc2beb3 with Priority: HIGHEST for action security_group_rules [ 1072.687289] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9378f72e-568d-4e53-8f92-4547bbc2beb3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.687289] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.687289] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.687289] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.687289] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9378f72e-568d-4e53-8f92-4547bbc2beb3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.768790] env[70013]: INFO networking_nsxv3.common.synchronization [None req-abbf8b44-06e8-4d5c-9aa7-ad8c966a460b tempest-AttachVolumeNegativeTest-680083968 tempest-AttachVolumeNegativeTest-680083968-project-member] Enqueued Resource ID: 9378f72e-568d-4e53-8f92-4547bbc2beb3 with Priority: HIGHEST for action security_group_rules [ 1072.768790] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9378f72e-568d-4e53-8f92-4547bbc2beb3 with Priority: HIGHEST for action security_group_rules [ 1072.768879] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9378f72e-568d-4e53-8f92-4547bbc2beb3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.769874] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.890078] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.890078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.890078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.890078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.911729] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.911729] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.911729] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.911729] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.911729] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.911729] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.911729] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 is going to be updated. [ 1072.943083] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.943083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.943083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.943083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.943083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.949543] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 in Status: IN_PROGRESS for 2s [ 1073.233096] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.233406] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.233406] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.233549] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.233640] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.233737] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9378f72e-568d-4e53-8f92-4547bbc2beb3 already deleted. [ 1073.233821] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.233987] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.234162] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.234246] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9378f72e-568d-4e53-8f92-4547bbc2beb3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.346411] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4d87c55-80bd-46c8-8078-256c25d0bf4b in Status: SUCCESS [ 1073.346779] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4d87c55-80bd-46c8-8078-256c25d0bf4b deletion is rescheduled due to dependency. [ 1073.346911] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4d87c55-80bd-46c8-8078-256c25d0bf4b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.796646] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.796646] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.796646] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.796646] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.796646] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.796646] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9378f72e-568d-4e53-8f92-4547bbc2beb3 already deleted. [ 1073.796646] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.452988] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 in Status: SUCCESS [ 1074.453364] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.555668] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 in Status: SUCCESS [ 1074.555921] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.654756] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 in Status: SUCCESS [ 1074.654756] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 deletion is rescheduled due to dependency. [ 1074.654756] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.958976] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 in Status: SUCCESS [ 1074.960505] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f6998667-5e88-456a-b064-7faf8fc4bfd8 deletion is rescheduled due to dependency. [ 1074.960505] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f6998667-5e88-456a-b064-7faf8fc4bfd8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.314767] env[70013]: INFO networking_nsxv3.common.synchronization [req-298e0ede-04d2-47dd-ac28-8e14e0155af4 req-6ab126d9-0467-4f2d-b059-9f14bb6fb295 tempest-ServersTestJSON-1543902807 tempest-ServersTestJSON-1543902807-project-member] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 1075.315441] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 1075.315806] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.315939] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.317259] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.317259] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.317259] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.317259] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.317259] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.317259] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.317259] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.317259] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.819703] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.322837] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.825617] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.826051] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.826051] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.826186] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.826279] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.826401] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a is going to be updated. [ 1076.855645] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.855888] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.855888] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.856073] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.856251] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.864220] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: IN_PROGRESS for 2s [ 1077.386886] env[70013]: INFO networking_nsxv3.common.synchronization [req-c06a08c8-5840-4d6d-80cb-cc7d203af594 req-60b37e56-8439-433d-b508-eef6d2b8eeaf tempest-DeleteServersTestJSON-1971284771 tempest-DeleteServersTestJSON-1971284771-project-member] Enqueued Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 1077.387435] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 1077.387739] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.387854] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.387922] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.388142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.388298] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.388396] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.388457] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.388602] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.388676] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.388778] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.680279] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-446 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.680494] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-446" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.680625] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-446" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.680913] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-446" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.681192] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.681356] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.681476] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.681693] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.681868] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.682658] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1077.682805] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1077.682926] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1077.683056] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1077.683293] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1077.683293] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1077.683419] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1077.707322] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1077.707591] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1077.707862] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1077.708094] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-446" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.708492] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-9156bf4c-eba1-4b04-b328-19e9968900cb taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.708708] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-9156bf4c-eba1-4b04-b328-19e9968900cb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.708779] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-9156bf4c-eba1-4b04-b328-19e9968900cb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.709116] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-9156bf4c-eba1-4b04-b328-19e9968900cb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.709279] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9156bf4c-eba1-4b04-b328-19e9968900cb',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.891868] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.892211] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.892211] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.892372] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.892446] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.892656] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.892753] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.892823] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.892988] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.893086] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.893175] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b is going to be deleted. [ 1077.928530] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.928684] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.928756] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.929061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.929138] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.929311] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.213224] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.213529] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.213710] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.214102] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.214318] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.214534] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 9156bf4c-eba1-4b04-b328-19e9968900cb not found, creating... [ 1078.214932] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.215135] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.215312] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.215621] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.215833] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.216381] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.216618] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.216809] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.217089] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.217284] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.217483] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 9156bf4c-eba1-4b04-b328-19e9968900cb is going to be created. [ 1078.254753] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.255037] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.255214] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.256306] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.256306] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.256306] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-9156bf4c-eba1-4b04-b328-19e9968900cb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.879617] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: SUCCESS [ 1078.879866] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.986706] env[70013]: INFO networking_nsxv3.common.synchronization [req-c06a08c8-5840-4d6d-80cb-cc7d203af594 req-2a7b6d8d-6eb8-47e3-ac12-f502033b0999 service nova] Enqueued Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_rules [ 1078.986954] env[70013]: INFO networking_nsxv3.common.synchronization [req-c06a08c8-5840-4d6d-80cb-cc7d203af594 req-2a7b6d8d-6eb8-47e3-ac12-f502033b0999 service nova] Enqueued Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 1078.987108] env[70013]: INFO networking_nsxv3.common.synchronization [req-c06a08c8-5840-4d6d-80cb-cc7d203af594 req-2a7b6d8d-6eb8-47e3-ac12-f502033b0999 service nova] Enqueued Resource ID: 9156bf4c-eba1-4b04-b328-19e9968900cb with Priority: HIGHEST for action port [ 1078.987380] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_rules [ 1078.987518] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 1078.987667] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9156bf4c-eba1-4b04-b328-19e9968900cb with Priority: HIGHEST for action port [ 1078.988220] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.988350] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.988416] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.988615] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.988689] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.990349] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.990349] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.990474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.990562] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.990747] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.990809] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.991338] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.991338] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.991338] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.991338] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.991930] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-9156bf4c-eba1-4b04-b328-19e9968900cb taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.992045] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9156bf4c-eba1-4b04-b328-19e9968900cb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.992109] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9156bf4c-eba1-4b04-b328-19e9968900cb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.992257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9156bf4c-eba1-4b04-b328-19e9968900cb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.992326] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9156bf4c-eba1-4b04-b328-19e9968900cb',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.494591] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.495752] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.495897] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.498390] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9156bf4c-eba1-4b04-b328-19e9968900cb with status ACTIVE [ 1079.498576] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.498692] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.498759] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.498963] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.499064] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.499229] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.499326] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.499387] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.499542] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.499619] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.499810] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.499948] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.500040] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.500190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.500265] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.500349] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9156bf4c-eba1-4b04-b328-19e9968900cb is going to be updated. [ 1079.528553] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.528795] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.528795] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.528954] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.529121] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.529275] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9156bf4c-eba1-4b04-b328-19e9968900cb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.769788] env[70013]: INFO networking_nsxv3.common.synchronization [req-4ef87d9f-8db4-4311-9349-fafbb63e6cef req-d0a636c8-fe8a-44bf-90d4-e6913b883a6f tempest-ServerAddressesTestJSON-1180661610 tempest-ServerAddressesTestJSON-1180661610-project-member] Enqueued Resource ID: 2989abf8-9869-43ad-95d4-6dd97b3a3deb with Priority: HIGHEST for action security_group_members [ 1079.770056] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2989abf8-9869-43ad-95d4-6dd97b3a3deb with Priority: HIGHEST for action security_group_members [ 1079.770706] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989abf8-9869-43ad-95d4-6dd97b3a3deb taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.771473] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.771473] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.771595] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.771707] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.772298] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.772298] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.772298] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.772298] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.772445] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2989abf8-9869-43ad-95d4-6dd97b3a3deb',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.997389] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.097149] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-142 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.097379] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-142" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.097522] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-142" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.097967] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-142" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.098159] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.098452] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.098452] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.098669] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.098898] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.099105] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1080.099229] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1080.099342] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1080.099456] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1080.099569] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1080.099681] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1080.099815] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1080.120093] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1080.120307] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1080.120424] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1080.120603] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-142" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.120923] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-40ed203a-db04-4cf2-abb9-8399b1af2672 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.121117] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-40ed203a-db04-4cf2-abb9-8399b1af2672" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.121242] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-40ed203a-db04-4cf2-abb9-8399b1af2672" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.121644] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-40ed203a-db04-4cf2-abb9-8399b1af2672" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.121783] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40ed203a-db04-4cf2-abb9-8399b1af2672',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.275016] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.275216] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.275314] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.275514] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.275606] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.275802] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.275898] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.275960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.276125] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.276202] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.276288] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2989abf8-9869-43ad-95d4-6dd97b3a3deb already deleted. [ 1080.276366] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.499621] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.499828] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.499867] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.500125] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.500218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.500323] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b is going to be created. [ 1080.545134] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.545365] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.545365] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.545564] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.545728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.563244] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: UNINITIALIZED for 2s [ 1080.623584] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.623812] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.624097] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.624423] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.624576] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.624751] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 40ed203a-db04-4cf2-abb9-8399b1af2672 not found, creating... [ 1080.625154] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.625390] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.625522] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.625765] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.625917] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.626235] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.626402] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.626654] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.626737] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.626907] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.627141] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 40ed203a-db04-4cf2-abb9-8399b1af2672 is going to be created. [ 1080.660848] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.660848] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.660848] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.660848] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.660848] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.660848] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-40ed203a-db04-4cf2-abb9-8399b1af2672" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.528889] env[70013]: INFO networking_nsxv3.common.synchronization [req-4ef87d9f-8db4-4311-9349-fafbb63e6cef req-18d8b0e8-bfba-4895-8761-e11ee606f359 service nova] Enqueued Resource ID: 2989abf8-9869-43ad-95d4-6dd97b3a3deb with Priority: HIGHEST for action security_group_rules [ 1081.529148] env[70013]: INFO networking_nsxv3.common.synchronization [req-4ef87d9f-8db4-4311-9349-fafbb63e6cef req-18d8b0e8-bfba-4895-8761-e11ee606f359 service nova] Enqueued Resource ID: 2989abf8-9869-43ad-95d4-6dd97b3a3deb with Priority: HIGHEST for action security_group_members [ 1081.529237] env[70013]: INFO networking_nsxv3.common.synchronization [req-4ef87d9f-8db4-4311-9349-fafbb63e6cef req-18d8b0e8-bfba-4895-8761-e11ee606f359 service nova] Enqueued Resource ID: 40ed203a-db04-4cf2-abb9-8399b1af2672 with Priority: HIGHEST for action port [ 1081.529458] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2989abf8-9869-43ad-95d4-6dd97b3a3deb with Priority: HIGHEST for action security_group_rules [ 1081.529588] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2989abf8-9869-43ad-95d4-6dd97b3a3deb with Priority: HIGHEST for action security_group_members [ 1081.529684] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ed203a-db04-4cf2-abb9-8399b1af2672 with Priority: HIGHEST for action port [ 1081.530239] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2989abf8-9869-43ad-95d4-6dd97b3a3deb taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.530368] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.530434] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.530696] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.530782] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2989abf8-9869-43ad-95d4-6dd97b3a3deb',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.531595] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989abf8-9869-43ad-95d4-6dd97b3a3deb taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.531708] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.531772] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.531936] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.532096] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.532194] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.532256] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.532396] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.532487] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.532563] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2989abf8-9869-43ad-95d4-6dd97b3a3deb',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.533279] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-40ed203a-db04-4cf2-abb9-8399b1af2672 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.533386] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40ed203a-db04-4cf2-abb9-8399b1af2672" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.533455] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40ed203a-db04-4cf2-abb9-8399b1af2672" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.533603] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40ed203a-db04-4cf2-abb9-8399b1af2672" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.533678] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40ed203a-db04-4cf2-abb9-8399b1af2672',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.036358] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989abf8-9869-43ad-95d4-6dd97b3a3deb taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.036740] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.037165] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2989abf8-9869-43ad-95d4-6dd97b3a3deb',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.038316] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40ed203a-db04-4cf2-abb9-8399b1af2672 with status ACTIVE [ 1082.039089] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.040199] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.040199] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.040199] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.040199] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.040199] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.040199] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.040506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.040506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.040579] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.040776] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.040868] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.040935] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.041120] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.041196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.041281] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40ed203a-db04-4cf2-abb9-8399b1af2672 is going to be updated. [ 1082.060493] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.061400] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.061400] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.061400] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.061400] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.061400] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40ed203a-db04-4cf2-abb9-8399b1af2672" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.543501] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2989abf8-9869-43ad-95d4-6dd97b3a3deb',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.572058] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: SUCCESS [ 1082.572313] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.572459] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.572671] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.572866] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.572999] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.573072] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.573207] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.573287] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.573374] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.573481] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.046333] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.046491] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.046742] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.046790] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.046887] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.046945] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2989abf8-9869-43ad-95d4-6dd97b3a3deb is going to be created. [ 1083.071184] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.071271] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.071312] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.071556] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.071729] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.076236] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.076407] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.076501] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.076715] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.076875] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.077037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.077151] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.077364] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.077510] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.077628] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.077804] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.077926] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.078028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.078193] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.078418] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.078545] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.078638] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.078806] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.078908] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.079028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.079126] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.081507] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2989abf8-9869-43ad-95d4-6dd97b3a3deb in Status: UNINITIALIZED for 2s [ 1083.581649] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16c877e7-f731-49a5-b994-7d74c36c464b: rpc.has_security_group_logging(os_id): False [ 1083.608340] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.608563] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.608563] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.608803] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.608934] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.609176] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.609294] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.609345] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.609504] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.609589] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.609785] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.609898] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.610032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.610131] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.610215] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.610364] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.610440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.610496] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.610681] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.610790] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.610909] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b is going to be created. [ 1083.678791] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.679047] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.679047] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.679247] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.679437] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.698387] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: IN_PROGRESS for 2s [ 1083.899143] env[70013]: INFO networking_nsxv3.common.synchronization [req-f0c4cd5c-4ad1-4bcc-83a7-ca4e3d5f0d95 req-45328200-0630-43d1-9ffc-d952b1092d6b tempest-ServerDiskConfigTestJSON-536876121 tempest-ServerDiskConfigTestJSON-536876121-project-member] Enqueued Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1083.899143] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1083.899143] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.899143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.899143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.899143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.899143] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.899143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.899143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.899692] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.899908] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.900130] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.222598] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-194 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.222598] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-194" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.222598] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-194" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.222598] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-194" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.222910] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.222910] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.223064] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.223308] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.223457] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.223672] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1084.223788] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1084.223897] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1084.224027] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1084.224133] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1084.224251] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1084.224385] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1084.244036] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1084.244149] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1084.244238] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1084.244416] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-194" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.244757] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-36abe182-e89a-4325-9d00-ce204c53a359 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.244937] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-36abe182-e89a-4325-9d00-ce204c53a359" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.245177] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-36abe182-e89a-4325-9d00-ce204c53a359" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.245593] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-36abe182-e89a-4325-9d00-ce204c53a359" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.245742] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36abe182-e89a-4325-9d00-ce204c53a359',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.403354] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.404735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.404735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.404735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.404735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.404735] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.404735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.404735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.404735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.404735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.404735] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f8a4673-59c5-493b-8250-617958bf996b is going to be deleted. [ 1084.435560] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.435705] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.436398] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.436398] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.436398] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.436398] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.747828] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.748205] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.748392] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.748732] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.748944] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.749167] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 36abe182-e89a-4325-9d00-ce204c53a359 not found, creating... [ 1084.749451] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.749615] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.749735] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.749975] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.750134] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.750420] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.750576] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.750694] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.750972] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.751284] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.751485] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 36abe182-e89a-4325-9d00-ce204c53a359 is going to be created. [ 1084.770273] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.770598] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.770730] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.771038] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.771291] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.771614] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-36abe182-e89a-4325-9d00-ce204c53a359" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.097795] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2989abf8-9869-43ad-95d4-6dd97b3a3deb in Status: SUCCESS [ 1085.097795] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.097795] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.097795] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.097795] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.097795] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.097795] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.097795] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.097795] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.097795] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.097795] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2989abf8-9869-43ad-95d4-6dd97b3a3deb',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.486259] env[70013]: INFO networking_nsxv3.common.synchronization [req-f0c4cd5c-4ad1-4bcc-83a7-ca4e3d5f0d95 req-cd846de6-2bc6-443d-b0bb-fd24909a65f1 service nova] Enqueued Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_rules [ 1085.486469] env[70013]: INFO networking_nsxv3.common.synchronization [req-f0c4cd5c-4ad1-4bcc-83a7-ca4e3d5f0d95 req-cd846de6-2bc6-443d-b0bb-fd24909a65f1 service nova] Enqueued Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1085.486559] env[70013]: INFO networking_nsxv3.common.synchronization [req-f0c4cd5c-4ad1-4bcc-83a7-ca4e3d5f0d95 req-cd846de6-2bc6-443d-b0bb-fd24909a65f1 service nova] Enqueued Resource ID: 36abe182-e89a-4325-9d00-ce204c53a359 with Priority: HIGHEST for action port [ 1085.486732] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_rules [ 1085.486865] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1085.486963] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36abe182-e89a-4325-9d00-ce204c53a359 with Priority: HIGHEST for action port [ 1085.487586] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.487714] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.487805] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.487984] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.489260] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.490212] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.490212] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.490344] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.490467] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.490622] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.490989] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.490989] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.490989] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.490989] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.491146] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.492271] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-36abe182-e89a-4325-9d00-ce204c53a359 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.492365] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36abe182-e89a-4325-9d00-ce204c53a359" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.492476] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36abe182-e89a-4325-9d00-ce204c53a359" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.492701] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36abe182-e89a-4325-9d00-ce204c53a359" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.492822] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36abe182-e89a-4325-9d00-ce204c53a359',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.595692] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989abf8-9869-43ad-95d4-6dd97b3a3deb taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.595880] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.595952] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.596278] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.596478] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.596594] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.596663] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.596848] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.596941] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.597081] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.597298] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989abf8-9869-43ad-95d4-6dd97b3a3deb taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.597406] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.597467] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.597625] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.597770] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.597863] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.597928] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.598082] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.598168] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.598249] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.598347] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2989abf8-9869-43ad-95d4-6dd97b3a3deb',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.712229] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: SUCCESS [ 1085.712498] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.994735] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.995833] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.995975] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.996140] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36abe182-e89a-4325-9d00-ce204c53a359 with status ACTIVE [ 1085.996301] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.996406] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.996472] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.996672] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.996764] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.996932] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.997040] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.997106] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.997262] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.997343] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.997523] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.997615] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.997677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.997817] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.997893] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.997977] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36abe182-e89a-4325-9d00-ce204c53a359 is going to be updated. [ 1086.017058] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.017249] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.017294] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.017520] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.017659] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.017807] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36abe182-e89a-4325-9d00-ce204c53a359" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.100660] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2989abf8-9869-43ad-95d4-6dd97b3a3deb: rpc.has_security_group_logging(os_id): False [ 1086.119537] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.119639] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.119714] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.119936] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.120180] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.120442] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.120550] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.120615] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.120773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.120854] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.121044] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.121142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.121205] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.121344] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.121418] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.121619] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.121684] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.121733] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.121906] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.121949] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.122020] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2989abf8-9869-43ad-95d4-6dd97b3a3deb is going to be created. [ 1086.192742] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.192901] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.193112] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.193236] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.193421] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.207631] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2989abf8-9869-43ad-95d4-6dd97b3a3deb in Status: IN_PROGRESS for 2s [ 1086.334388] env[70013]: INFO networking_nsxv3.common.synchronization [req-0f5fbf66-651b-4101-b794-9191f00b2a99 req-46a2e1ae-e3fe-4d97-824c-42fcaf3873f0 tempest-ServerMetadataTestJSON-787941395 tempest-ServerMetadataTestJSON-787941395-project-member] Enqueued Resource ID: ab1f82be-3036-4adf-bad7-5cfb8bab5684 with Priority: HIGHEST for action security_group_members [ 1086.336830] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab1f82be-3036-4adf-bad7-5cfb8bab5684 with Priority: HIGHEST for action security_group_members [ 1086.336830] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab1f82be-3036-4adf-bad7-5cfb8bab5684 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.336830] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.336830] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.336830] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.336830] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.336830] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.336830] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.337279] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.337279] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.337279] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab1f82be-3036-4adf-bad7-5cfb8bab5684',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.499721] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.674783] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-123 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.675049] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-123" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.675204] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-123" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.675533] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-123" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.675808] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.676353] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.676528] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.676801] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.677011] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.677266] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1086.677424] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1086.677574] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1086.677722] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1086.677919] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1086.678032] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1086.678208] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1086.701746] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1086.701746] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1086.701746] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1086.701746] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-123" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.701746] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-54da9b83-48b2-4a5a-b141-d4c02fe9fdb8 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.701746] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-54da9b83-48b2-4a5a-b141-d4c02fe9fdb8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.701746] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-54da9b83-48b2-4a5a-b141-d4c02fe9fdb8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.701746] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-54da9b83-48b2-4a5a-b141-d4c02fe9fdb8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.701746] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54da9b83-48b2-4a5a-b141-d4c02fe9fdb8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.839940] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.840137] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.840269] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.840449] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.840602] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.840886] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.841051] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.841148] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.841371] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.841490] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.841623] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab1f82be-3036-4adf-bad7-5cfb8bab5684 already deleted. [ 1086.841736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.005952] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.006308] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.006356] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.006694] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.006857] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.007028] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f8a4673-59c5-493b-8250-617958bf996b is going to be created. [ 1087.030713] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.031950] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.031950] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.031950] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.031950] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.040871] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: UNINITIALIZED for 2s [ 1087.205396] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.205612] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.205777] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.206311] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.206642] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.206948] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 54da9b83-48b2-4a5a-b141-d4c02fe9fdb8 not found, creating... [ 1087.207477] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.207700] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.207839] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.208113] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.208276] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.208580] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.208745] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.208867] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.209114] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.209264] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.209411] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 54da9b83-48b2-4a5a-b141-d4c02fe9fdb8 is going to be created. [ 1087.262716] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.262968] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.263154] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.263413] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.263672] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.263896] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-54da9b83-48b2-4a5a-b141-d4c02fe9fdb8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.947950] env[70013]: INFO networking_nsxv3.common.synchronization [req-0f5fbf66-651b-4101-b794-9191f00b2a99 req-606716c4-20ae-479f-9be4-844c0c35a2ff service nova] Enqueued Resource ID: ab1f82be-3036-4adf-bad7-5cfb8bab5684 with Priority: HIGHEST for action security_group_rules [ 1087.948155] env[70013]: INFO networking_nsxv3.common.synchronization [req-0f5fbf66-651b-4101-b794-9191f00b2a99 req-606716c4-20ae-479f-9be4-844c0c35a2ff service nova] Enqueued Resource ID: ab1f82be-3036-4adf-bad7-5cfb8bab5684 with Priority: HIGHEST for action security_group_members [ 1087.948302] env[70013]: INFO networking_nsxv3.common.synchronization [req-0f5fbf66-651b-4101-b794-9191f00b2a99 req-606716c4-20ae-479f-9be4-844c0c35a2ff service nova] Enqueued Resource ID: 54da9b83-48b2-4a5a-b141-d4c02fe9fdb8 with Priority: HIGHEST for action port [ 1087.948536] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab1f82be-3036-4adf-bad7-5cfb8bab5684 with Priority: HIGHEST for action security_group_rules [ 1087.948667] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab1f82be-3036-4adf-bad7-5cfb8bab5684 with Priority: HIGHEST for action security_group_members [ 1087.948764] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54da9b83-48b2-4a5a-b141-d4c02fe9fdb8 with Priority: HIGHEST for action port [ 1087.949341] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab1f82be-3036-4adf-bad7-5cfb8bab5684 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.949472] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.949553] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.949810] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.949895] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab1f82be-3036-4adf-bad7-5cfb8bab5684',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.951589] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab1f82be-3036-4adf-bad7-5cfb8bab5684 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.951706] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.951775] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.952058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.952250] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.952390] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.952461] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.953118] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.953219] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.953319] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab1f82be-3036-4adf-bad7-5cfb8bab5684',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.954110] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-54da9b83-48b2-4a5a-b141-d4c02fe9fdb8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.954210] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54da9b83-48b2-4a5a-b141-d4c02fe9fdb8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.954277] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54da9b83-48b2-4a5a-b141-d4c02fe9fdb8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.954427] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54da9b83-48b2-4a5a-b141-d4c02fe9fdb8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.954508] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54da9b83-48b2-4a5a-b141-d4c02fe9fdb8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.221044] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2989abf8-9869-43ad-95d4-6dd97b3a3deb in Status: SUCCESS [ 1088.221320] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.456557] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab1f82be-3036-4adf-bad7-5cfb8bab5684',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.457661] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab1f82be-3036-4adf-bad7-5cfb8bab5684 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.457786] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.457921] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54da9b83-48b2-4a5a-b141-d4c02fe9fdb8 with status ACTIVE [ 1088.458897] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.458897] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.458897] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.458897] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.458897] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.458897] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.458897] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.458897] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.459238] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.459238] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.459292] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.459377] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.459437] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.459754] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.459844] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.459929] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54da9b83-48b2-4a5a-b141-d4c02fe9fdb8 is going to be updated. [ 1088.481860] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.482131] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.482216] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.482456] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.482825] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.483074] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54da9b83-48b2-4a5a-b141-d4c02fe9fdb8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.962760] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab1f82be-3036-4adf-bad7-5cfb8bab5684',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.052160] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: SUCCESS [ 1089.052372] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.052625] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.052926] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.053044] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.053181] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.053269] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.053455] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.053548] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.053628] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.053721] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.465529] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.465832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.465832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.465832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.465958] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.466035] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab1f82be-3036-4adf-bad7-5cfb8bab5684 is going to be created. [ 1089.490272] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.490423] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.490496] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.490713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.491522] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.499535] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab1f82be-3036-4adf-bad7-5cfb8bab5684 in Status: UNINITIALIZED for 2s [ 1089.559195] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.559324] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.559398] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.559624] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.559793] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.559894] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.559961] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.560250] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.560390] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.560438] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.560556] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.560649] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.560710] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.560862] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.561008] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.561113] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.561175] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.561316] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.561392] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.561723] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.561723] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.064118] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f8a4673-59c5-493b-8250-617958bf996b: rpc.has_security_group_logging(os_id): False [ 1090.081397] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.081666] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.081666] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.081852] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.081942] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.082177] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.082283] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.082364] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.082496] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.082566] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.082741] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.082844] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.082930] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.083167] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.083258] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.083442] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.083562] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.083627] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.083729] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.083801] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.083877] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f8a4673-59c5-493b-8250-617958bf996b is going to be created. [ 1090.139865] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.139865] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.139865] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.140395] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.140395] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.155811] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: IN_PROGRESS for 2s [ 1091.509420] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab1f82be-3036-4adf-bad7-5cfb8bab5684 in Status: SUCCESS [ 1091.509865] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.509865] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.510063] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.510270] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.510397] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.510465] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.510648] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.510747] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.510840] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.510934] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab1f82be-3036-4adf-bad7-5cfb8bab5684',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.013412] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab1f82be-3036-4adf-bad7-5cfb8bab5684 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.013643] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.013767] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.014106] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.014366] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.014529] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.014640] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.014889] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.015083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.015244] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.015483] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab1f82be-3036-4adf-bad7-5cfb8bab5684 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.015641] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.015754] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.015984] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.016247] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.016405] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.016487] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.016725] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.016853] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.016995] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.017164] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab1f82be-3036-4adf-bad7-5cfb8bab5684',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.169870] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: SUCCESS [ 1092.170162] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.313484] env[70013]: INFO networking_nsxv3.common.synchronization [req-b38451ea-4e47-44d0-b69e-c3b331736001 req-a4196f33-14fc-4109-a213-202d5e9789f1 tempest-DeleteServersTestJSON-1971284771 tempest-DeleteServersTestJSON-1971284771-project-member] Enqueued Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 1092.313637] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 1092.314077] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.316284] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.316471] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.316591] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.316834] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.316941] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.317074] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.317246] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.317335] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.317434] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.520242] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab1f82be-3036-4adf-bad7-5cfb8bab5684: rpc.has_security_group_logging(os_id): False [ 1092.537870] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.538023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.538100] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.538347] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.538453] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.538626] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.538754] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.538834] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.538999] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.539143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.539346] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.539443] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.539507] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.539665] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.539745] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.539957] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.540069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.540203] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.540275] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.540356] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.540443] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab1f82be-3036-4adf-bad7-5cfb8bab5684 is going to be created. [ 1092.599828] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.600057] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.600108] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.600392] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.600627] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.611722] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab1f82be-3036-4adf-bad7-5cfb8bab5684 in Status: IN_PROGRESS for 2s [ 1092.823734] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.823734] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.823734] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.823734] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.823734] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.823734] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.824133] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.824133] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.824205] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.825114] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.825114] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b is going to be updated. [ 1092.852739] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.852998] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.853132] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.853383] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.853535] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.863533] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: IN_PROGRESS for 2s [ 1092.962958] env[70013]: INFO networking_nsxv3.common.synchronization [req-ef6d8cc0-451b-4b46-bcaf-0eedc7adb4e2 req-69fc2de9-b63f-43f5-a24c-7c4183af278c tempest-ServerAddressesTestJSON-1180661610 tempest-ServerAddressesTestJSON-1180661610-project-member] Enqueued Resource ID: 2989abf8-9869-43ad-95d4-6dd97b3a3deb with Priority: HIGHEST for action security_group_members [ 1092.964315] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2989abf8-9869-43ad-95d4-6dd97b3a3deb with Priority: HIGHEST for action security_group_members [ 1092.964315] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-2989abf8-9869-43ad-95d4-6dd97b3a3deb taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.964315] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.964315] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.964644] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.964821] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.964951] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.965031] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.965223] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.965315] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.965412] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2989abf8-9869-43ad-95d4-6dd97b3a3deb',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.468600] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.468772] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.468845] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.469082] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.469182] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.469386] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.469488] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.469552] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.469699] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.469776] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.469862] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2989abf8-9869-43ad-95d4-6dd97b3a3deb is going to be updated. [ 1093.511070] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.511235] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.511309] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.511527] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.511672] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.523581] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2989abf8-9869-43ad-95d4-6dd97b3a3deb in Status: IN_PROGRESS for 2s [ 1094.623723] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab1f82be-3036-4adf-bad7-5cfb8bab5684 in Status: SUCCESS [ 1094.623988] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.872870] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: SUCCESS [ 1094.873116] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b deletion is rescheduled due to dependency. [ 1094.873251] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.523641] env[70013]: INFO networking_nsxv3.common.synchronization [req-938020f6-2bae-43f8-88a3-b7caad11707a req-bb956f17-c5c9-4f94-ab20-66df6c81c616 tempest-ServerRescueNegativeTestJSON-1808745105 tempest-ServerRescueNegativeTestJSON-1808745105-project-member] Enqueued Resource ID: 250f9011-1d0c-4c88-9907-8d448831417a with Priority: HIGHEST for action security_group_members [ 1095.525944] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250f9011-1d0c-4c88-9907-8d448831417a with Priority: HIGHEST for action security_group_members [ 1095.525944] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f9011-1d0c-4c88-9907-8d448831417a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.525944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.525944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.526261] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.526261] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.526429] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.526534] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.526776] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.526916] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.527074] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('250f9011-1d0c-4c88-9907-8d448831417a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.535515] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2989abf8-9869-43ad-95d4-6dd97b3a3deb in Status: SUCCESS [ 1095.535515] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2989abf8-9869-43ad-95d4-6dd97b3a3deb deletion is rescheduled due to dependency. [ 1095.535605] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.802374] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-902 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.802688] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-902" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.802906] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-902" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.803352] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-902" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.803754] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.804012] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.804239] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.804580] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.804823] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.805179] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1095.805379] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1095.805572] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1095.805764] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1095.805969] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1095.806182] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1095.806416] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1095.824560] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1095.824784] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1095.825019] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1095.825310] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-902" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.825767] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-2573d470-4c75-40c7-9e9b-6130f5e14092 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.826035] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-2573d470-4c75-40c7-9e9b-6130f5e14092" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.826241] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-2573d470-4c75-40c7-9e9b-6130f5e14092" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.826677] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-2573d470-4c75-40c7-9e9b-6130f5e14092" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.826901] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2573d470-4c75-40c7-9e9b-6130f5e14092',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.029468] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.029468] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.030019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.030019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.030019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.030223] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.030356] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.030416] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.030608] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.031202] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.031202] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 250f9011-1d0c-4c88-9907-8d448831417a already deleted. [ 1096.031202] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.329931] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.330206] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.330355] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.330688] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.330887] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.331079] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 2573d470-4c75-40c7-9e9b-6130f5e14092 not found, creating... [ 1096.331373] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.331537] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.331661] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.331933] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.332141] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.332488] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.332700] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.332849] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.333089] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.333274] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.333439] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 2573d470-4c75-40c7-9e9b-6130f5e14092 is going to be created. [ 1096.352155] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.352371] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.352538] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.352838] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.353135] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.353406] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-2573d470-4c75-40c7-9e9b-6130f5e14092" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.034266] env[70013]: INFO networking_nsxv3.common.synchronization [req-938020f6-2bae-43f8-88a3-b7caad11707a req-9bf37c40-f6c0-46b7-983c-19f1f81bb32f service nova] Enqueued Resource ID: 250f9011-1d0c-4c88-9907-8d448831417a with Priority: HIGHEST for action security_group_rules [ 1097.034520] env[70013]: INFO networking_nsxv3.common.synchronization [req-938020f6-2bae-43f8-88a3-b7caad11707a req-9bf37c40-f6c0-46b7-983c-19f1f81bb32f service nova] Enqueued Resource ID: 250f9011-1d0c-4c88-9907-8d448831417a with Priority: HIGHEST for action security_group_members [ 1097.034619] env[70013]: INFO networking_nsxv3.common.synchronization [req-938020f6-2bae-43f8-88a3-b7caad11707a req-9bf37c40-f6c0-46b7-983c-19f1f81bb32f service nova] Enqueued Resource ID: 2573d470-4c75-40c7-9e9b-6130f5e14092 with Priority: HIGHEST for action port [ 1097.034809] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250f9011-1d0c-4c88-9907-8d448831417a with Priority: HIGHEST for action security_group_rules [ 1097.034938] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250f9011-1d0c-4c88-9907-8d448831417a with Priority: HIGHEST for action security_group_members [ 1097.035047] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2573d470-4c75-40c7-9e9b-6130f5e14092 with Priority: HIGHEST for action port [ 1097.035742] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-250f9011-1d0c-4c88-9907-8d448831417a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.035859] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.035947] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.036623] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.036718] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('250f9011-1d0c-4c88-9907-8d448831417a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.037542] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f9011-1d0c-4c88-9907-8d448831417a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.037656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.037726] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.038649] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.038900] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.039142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.039212] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.039366] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.039453] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.039632] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('250f9011-1d0c-4c88-9907-8d448831417a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.040729] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-2573d470-4c75-40c7-9e9b-6130f5e14092 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.040796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2573d470-4c75-40c7-9e9b-6130f5e14092" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.040835] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2573d470-4c75-40c7-9e9b-6130f5e14092" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.040975] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2573d470-4c75-40c7-9e9b-6130f5e14092" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.043592] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2573d470-4c75-40c7-9e9b-6130f5e14092',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.545159] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f9011-1d0c-4c88-9907-8d448831417a taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.545250] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.546024] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('250f9011-1d0c-4c88-9907-8d448831417a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.550282] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2573d470-4c75-40c7-9e9b-6130f5e14092 with status ACTIVE [ 1097.550557] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.550648] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.551281] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.551281] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.551281] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.551281] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.551575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.551575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.551575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.551575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.551802] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.551854] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.551884] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.552043] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.552141] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.552228] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2573d470-4c75-40c7-9e9b-6130f5e14092 is going to be updated. [ 1097.571611] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.571759] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.571796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.571988] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.572137] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.572294] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2573d470-4c75-40c7-9e9b-6130f5e14092" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.047440] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('250f9011-1d0c-4c88-9907-8d448831417a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.551547] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.551715] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.551794] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.552111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.552214] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.552313] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 250f9011-1d0c-4c88-9907-8d448831417a is going to be created. [ 1098.588857] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.589086] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.589171] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.589414] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.589611] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.599623] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250f9011-1d0c-4c88-9907-8d448831417a in Status: UNINITIALIZED for 2s [ 1100.612752] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250f9011-1d0c-4c88-9907-8d448831417a in Status: SUCCESS [ 1100.612752] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.612752] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.612752] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.612752] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.612752] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.612752] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.612752] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.612752] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.612752] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.612752] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('250f9011-1d0c-4c88-9907-8d448831417a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.115446] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('250f9011-1d0c-4c88-9907-8d448831417a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.618320] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 250f9011-1d0c-4c88-9907-8d448831417a: rpc.has_security_group_logging(os_id): False [ 1101.634935] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.635103] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.635195] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.635412] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.635503] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.635738] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.635837] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.635904] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.636064] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.636158] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.636575] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 250f9011-1d0c-4c88-9907-8d448831417a is going to be created. [ 1101.690545] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.690545] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.690901] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.690971] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.691287] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.702679] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 250f9011-1d0c-4c88-9907-8d448831417a in Status: IN_PROGRESS for 2s [ 1102.036316] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1102.036402] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1102.065629] env[70013]: INFO networking_nsxv3.common.synchronization [req-56a3bdbb-0445-46d7-9c23-8f032c05dcdb req-6e822313-4d01-45e1-959d-6e63b95ed7bb tempest-ServerMetadataTestJSON-787941395 tempest-ServerMetadataTestJSON-787941395-project-member] Enqueued Resource ID: ab1f82be-3036-4adf-bad7-5cfb8bab5684 with Priority: HIGHEST for action security_group_members [ 1102.065688] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab1f82be-3036-4adf-bad7-5cfb8bab5684 with Priority: HIGHEST for action security_group_members [ 1102.066032] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab1f82be-3036-4adf-bad7-5cfb8bab5684 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.066207] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.066261] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.066443] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.066633] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.066722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.066813] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.066966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.067066] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.067180] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab1f82be-3036-4adf-bad7-5cfb8bab5684',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.569550] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.569732] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.569810] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.570077] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.570196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.570415] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.570538] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.570613] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.570786] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.570867] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.570957] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab1f82be-3036-4adf-bad7-5cfb8bab5684 is going to be updated. [ 1102.600036] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.600036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.600036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.600396] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.600396] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.608476] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab1f82be-3036-4adf-bad7-5cfb8bab5684 in Status: IN_PROGRESS for 2s [ 1103.369292] env[70013]: INFO networking_nsxv3.common.synchronization [req-9f52e54a-7b1a-436f-8391-67dce6cf6d39 req-ee738d0c-aebe-4bd7-a76a-c29016ad8a1a tempest-AttachVolumeNegativeTest-680083968 tempest-AttachVolumeNegativeTest-680083968-project-member] Enqueued Resource ID: 9378f72e-568d-4e53-8f92-4547bbc2beb3 with Priority: HIGHEST for action security_group_members [ 1103.369742] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9378f72e-568d-4e53-8f92-4547bbc2beb3 with Priority: HIGHEST for action security_group_members [ 1103.370056] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9378f72e-568d-4e53-8f92-4547bbc2beb3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.370183] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.370279] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.370534] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.370738] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.370807] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.370890] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.371032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.371123] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.371214] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9378f72e-568d-4e53-8f92-4547bbc2beb3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.668969] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-145 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.669201] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-145" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.669334] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-145" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.669618] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-145" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.669879] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.670049] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.670184] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.670402] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.670551] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.670764] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1103.670882] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1103.670994] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1103.671122] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1103.671237] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1103.671347] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1103.671510] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1103.713532] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 250f9011-1d0c-4c88-9907-8d448831417a in Status: SUCCESS [ 1103.713754] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.714675] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1103.714829] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.043 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1103.714977] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1103.715135] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-145" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.715463] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-8cef7e32-bdf1-41df-be67-ab80c6f894de taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.715633] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-8cef7e32-bdf1-41df-be67-ab80c6f894de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.715754] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-8cef7e32-bdf1-41df-be67-ab80c6f894de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.716066] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-8cef7e32-bdf1-41df-be67-ab80c6f894de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.716238] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cef7e32-bdf1-41df-be67-ab80c6f894de',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.877216] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.877667] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.877667] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.877667] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.877860] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.877925] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.878038] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.878126] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.878274] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.878360] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.878448] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9378f72e-568d-4e53-8f92-4547bbc2beb3 already deleted. [ 1103.878529] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.218846] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.219478] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.219633] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.219934] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.220104] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.220271] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 8cef7e32-bdf1-41df-be67-ab80c6f894de not found, creating... [ 1104.220548] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.220717] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.220840] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.221076] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.221222] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.221511] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.221669] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.221792] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.222009] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.222158] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.222303] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 8cef7e32-bdf1-41df-be67-ab80c6f894de is going to be created. [ 1104.242211] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.242425] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.242559] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.242808] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.243075] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.243297] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-8cef7e32-bdf1-41df-be67-ab80c6f894de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.619654] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab1f82be-3036-4adf-bad7-5cfb8bab5684 in Status: SUCCESS [ 1104.619654] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab1f82be-3036-4adf-bad7-5cfb8bab5684 deletion is rescheduled due to dependency. [ 1104.619967] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.930754] env[70013]: INFO networking_nsxv3.common.synchronization [req-9f52e54a-7b1a-436f-8391-67dce6cf6d39 req-ae748e5a-35cc-46a3-9ee6-fe120339aacc service nova] Enqueued Resource ID: 9378f72e-568d-4e53-8f92-4547bbc2beb3 with Priority: HIGHEST for action security_group_rules [ 1104.930754] env[70013]: INFO networking_nsxv3.common.synchronization [req-9f52e54a-7b1a-436f-8391-67dce6cf6d39 req-ae748e5a-35cc-46a3-9ee6-fe120339aacc service nova] Enqueued Resource ID: 9378f72e-568d-4e53-8f92-4547bbc2beb3 with Priority: HIGHEST for action security_group_members [ 1104.930754] env[70013]: INFO networking_nsxv3.common.synchronization [req-9f52e54a-7b1a-436f-8391-67dce6cf6d39 req-ae748e5a-35cc-46a3-9ee6-fe120339aacc service nova] Enqueued Resource ID: 8cef7e32-bdf1-41df-be67-ab80c6f894de with Priority: HIGHEST for action port [ 1104.930754] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9378f72e-568d-4e53-8f92-4547bbc2beb3 with Priority: HIGHEST for action security_group_rules [ 1104.930754] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9378f72e-568d-4e53-8f92-4547bbc2beb3 with Priority: HIGHEST for action security_group_members [ 1104.930754] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cef7e32-bdf1-41df-be67-ab80c6f894de with Priority: HIGHEST for action port [ 1104.931316] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9378f72e-568d-4e53-8f92-4547bbc2beb3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.931436] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.932191] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.932191] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.932191] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9378f72e-568d-4e53-8f92-4547bbc2beb3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.933373] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9378f72e-568d-4e53-8f92-4547bbc2beb3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.934077] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.934711] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.934711] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.935504] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.935504] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.935504] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.935504] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.935645] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.935645] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9378f72e-568d-4e53-8f92-4547bbc2beb3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.936655] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cef7e32-bdf1-41df-be67-ab80c6f894de taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.936655] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cef7e32-bdf1-41df-be67-ab80c6f894de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.936655] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cef7e32-bdf1-41df-be67-ab80c6f894de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.936789] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cef7e32-bdf1-41df-be67-ab80c6f894de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.936920] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cef7e32-bdf1-41df-be67-ab80c6f894de',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.438637] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9378f72e-568d-4e53-8f92-4547bbc2beb3 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.438637] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.438637] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8cef7e32-bdf1-41df-be67-ab80c6f894de with status ACTIVE [ 1105.446196] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.446196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.446196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.446196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.446196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.446196] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.446196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.446196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.446196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.446196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.446196] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.446196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.446196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.446196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.446196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.446196] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8cef7e32-bdf1-41df-be67-ab80c6f894de is going to be updated. [ 1105.446906] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9378f72e-568d-4e53-8f92-4547bbc2beb3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.462168] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.462321] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.462398] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.462595] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.462829] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.462906] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cef7e32-bdf1-41df-be67-ab80c6f894de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.943754] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9378f72e-568d-4e53-8f92-4547bbc2beb3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.446056] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.446242] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.446242] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.446492] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.446628] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.446758] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9378f72e-568d-4e53-8f92-4547bbc2beb3 is going to be created. [ 1106.471700] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.471854] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.471927] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.472167] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.472341] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.481063] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9378f72e-568d-4e53-8f92-4547bbc2beb3 in Status: UNINITIALIZED for 2s [ 1107.219017] env[70013]: INFO networking_nsxv3.common.synchronization [req-1dfbf0a8-6d74-40ac-b24f-b88a6fa08203 req-7e04d278-0a3b-493b-8781-f0dad35512db tempest-ServerDiskConfigTestJSON-536876121 tempest-ServerDiskConfigTestJSON-536876121-project-member] Enqueued Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1107.222613] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1107.222613] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.222613] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.222613] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.222613] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.222613] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.222835] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.222835] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.222889] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.222989] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.223080] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.254071] env[70013]: INFO networking_nsxv3.common.synchronization [req-976cd10e-5e5c-48a1-907c-a832163549cc req-2a368650-fc3e-417c-81c5-a819bf3a714a tempest-ServersTestJSON-1543902807 tempest-ServersTestJSON-1543902807-project-member] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 1107.254827] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 1107.254916] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.255016] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.259645] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.259967] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.260457] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.260457] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.260457] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.260684] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.261059] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.261059] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.728201] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.728361] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.728434] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.728652] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.728743] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.728954] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.729041] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.729108] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.729260] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.729369] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.729422] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f8a4673-59c5-493b-8250-617958bf996b is going to be updated. [ 1107.754876] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.754876] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.754876] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.754876] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.754876] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.763309] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: IN_PROGRESS for 2s [ 1107.767832] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.270278] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.491564] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9378f72e-568d-4e53-8f92-4547bbc2beb3 in Status: SUCCESS [ 1108.491844] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.492044] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.492268] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.492460] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.492577] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.492645] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.492822] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.492903] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.492990] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.493099] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9378f72e-568d-4e53-8f92-4547bbc2beb3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.772043] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.772215] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.772292] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.772506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.772604] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.772705] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a is going to be updated. [ 1108.803091] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.803091] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.803091] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.803091] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.803091] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.805157] env[70013]: INFO networking_nsxv3.common.synchronization [req-4fc5394b-d85d-4b9c-ab65-0b6e51f82a0e req-11ff198d-a009-40af-8176-da97693df8d3 tempest-AttachInterfacesTestJSON-1580231832 tempest-AttachInterfacesTestJSON-1580231832-project-member] Enqueued Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_members [ 1108.805685] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_members [ 1108.805932] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.806114] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.806173] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.806470] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.806633] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.806738] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.806801] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.806954] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.807056] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.807149] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.812412] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: IN_PROGRESS for 2s [ 1108.995244] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9378f72e-568d-4e53-8f92-4547bbc2beb3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.078754] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.078881] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.079022] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.079319] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.079577] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.079749] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.079871] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.080432] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.080432] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.080432] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1109.080578] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1109.080693] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1109.080882] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1109.082086] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1109.082086] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1109.082086] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1109.099021] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1109.099121] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1109.099214] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1109.099385] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.099675] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-5380cda0-d51f-4970-a418-c89ed561db06 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.099844] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-5380cda0-d51f-4970-a418-c89ed561db06" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.099968] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-5380cda0-d51f-4970-a418-c89ed561db06" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.100344] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-5380cda0-d51f-4970-a418-c89ed561db06" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.100543] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5380cda0-d51f-4970-a418-c89ed561db06',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.309408] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.309737] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.309737] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.309913] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.310030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.310252] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.310373] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.310450] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.310626] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.310723] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.310816] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 already deleted. [ 1109.310923] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.497696] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9378f72e-568d-4e53-8f92-4547bbc2beb3: rpc.has_security_group_logging(os_id): False [ 1109.515948] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.516175] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.516302] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.516563] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.516692] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.517033] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.517172] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.517244] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.517415] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.517508] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.517631] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9378f72e-568d-4e53-8f92-4547bbc2beb3 is going to be created. [ 1109.577560] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.577697] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.577777] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.578063] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.578300] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.589453] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9378f72e-568d-4e53-8f92-4547bbc2beb3 in Status: IN_PROGRESS for 2s [ 1109.602877] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.603165] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.603427] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.603847] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.604092] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.604270] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 5380cda0-d51f-4970-a418-c89ed561db06 not found, creating... [ 1109.604576] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.604772] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.604909] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.605165] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.605850] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.605850] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.606036] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.606150] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.606505] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.606733] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.606941] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 5380cda0-d51f-4970-a418-c89ed561db06 is going to be created. [ 1109.639374] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.639709] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.639875] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.640318] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.640577] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.640957] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-5380cda0-d51f-4970-a418-c89ed561db06" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.773173] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: SUCCESS [ 1109.773403] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f8a4673-59c5-493b-8250-617958bf996b deletion is rescheduled due to dependency. [ 1109.773526] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.307033] env[70013]: INFO networking_nsxv3.common.synchronization [req-4fc5394b-d85d-4b9c-ab65-0b6e51f82a0e req-595a2ffc-e7e6-4b83-844c-68afc1b6207e service nova] Enqueued Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_rules [ 1110.307033] env[70013]: INFO networking_nsxv3.common.synchronization [req-4fc5394b-d85d-4b9c-ab65-0b6e51f82a0e req-595a2ffc-e7e6-4b83-844c-68afc1b6207e service nova] Enqueued Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_members [ 1110.307518] env[70013]: INFO networking_nsxv3.common.synchronization [req-4fc5394b-d85d-4b9c-ab65-0b6e51f82a0e req-595a2ffc-e7e6-4b83-844c-68afc1b6207e service nova] Enqueued Resource ID: 5380cda0-d51f-4970-a418-c89ed561db06 with Priority: HIGHEST for action port [ 1110.308183] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_rules [ 1110.308323] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_members [ 1110.308431] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5380cda0-d51f-4970-a418-c89ed561db06 with Priority: HIGHEST for action port [ 1110.308719] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.308845] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.308914] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.309196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.309280] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.310153] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.310406] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.310406] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.310496] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.310645] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.310739] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.310802] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.310943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.311040] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.311129] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.311875] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-5380cda0-d51f-4970-a418-c89ed561db06 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.311983] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5380cda0-d51f-4970-a418-c89ed561db06" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.312061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5380cda0-d51f-4970-a418-c89ed561db06" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.312217] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5380cda0-d51f-4970-a418-c89ed561db06" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.312291] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5380cda0-d51f-4970-a418-c89ed561db06',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.681466] env[70013]: INFO networking_nsxv3.common.synchronization [req-bf74d57d-baa8-4165-8045-1dd70090ebff req-b219da42-496a-4b62-b67e-5d342e0bf012 tempest-ServerActionsTestJSON-1661939768 tempest-ServerActionsTestJSON-1661939768-project-member] Enqueued Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGHEST for action security_group_members [ 1110.682039] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGHEST for action security_group_members [ 1110.682365] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.682514] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.682597] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.682811] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.682969] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.683102] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.683231] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.683419] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.683570] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.683727] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.814033] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.814033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.815798] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.816853] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5380cda0-d51f-4970-a418-c89ed561db06 with status ACTIVE [ 1110.817132] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.817297] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.817817] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.817817] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.817817] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.818051] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.818414] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.818414] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.818525] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.818626] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.818897] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.819050] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.819345] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.819345] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.819453] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.819576] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5380cda0-d51f-4970-a418-c89ed561db06 is going to be updated. [ 1110.823758] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: SUCCESS [ 1110.824107] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.844390] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.844573] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.844713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.844975] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.845353] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.845447] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5380cda0-d51f-4970-a418-c89ed561db06" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.187895] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.188178] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.188252] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.188522] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.207932] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.208215] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.208335] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.208485] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.208609] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.208694] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.208784] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 is going to be updated. [ 1111.236134] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.236331] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.236417] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.236597] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.236799] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.248487] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 in Status: IN_PROGRESS for 2s [ 1111.321512] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.600390] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9378f72e-568d-4e53-8f92-4547bbc2beb3 in Status: SUCCESS [ 1111.600816] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.824818] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.824818] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.828919] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.828919] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.828919] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.828919] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 is going to be created. [ 1111.850553] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.850731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.850844] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.851083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.851249] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.875282] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: UNINITIALIZED for 2s [ 1113.258994] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 in Status: SUCCESS [ 1113.259253] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 deletion is rescheduled due to dependency. [ 1113.259349] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.885386] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: SUCCESS [ 1113.885780] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.885864] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.886221] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.886502] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.886669] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.886952] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.886952] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.887081] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.887206] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.887334] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.389749] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.390095] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.390095] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.390227] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.390396] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.390502] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.390567] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.390717] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.390806] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.390898] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.391058] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.391150] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.391213] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.391356] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.391495] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.391586] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.391646] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.391785] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.391861] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.391941] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.392044] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.894385] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4f3ddc1-2b27-4b61-95d8-aac256599271: rpc.has_security_group_logging(os_id): False [ 1114.912516] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.912516] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.912516] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.912691] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.912691] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.913354] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.913354] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.913354] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.913354] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.913354] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.913592] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.913592] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.913592] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.913710] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.913790] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.913986] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.914121] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.914160] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.914281] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.914357] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.914441] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 is going to be created. [ 1114.968487] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.968585] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.968662] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.969147] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.969147] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.978925] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: IN_PROGRESS for 2s [ 1115.683040] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1115.683334] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1116.990600] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: SUCCESS [ 1116.990885] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.009393] env[70013]: INFO networking_nsxv3.common.synchronization [req-bd4e1eb0-4528-4421-8a36-d1c9bf1e3c84 req-3e1cb7a4-2135-4256-af79-064193e2b854 tempest-ServerDiskConfigTestJSON-536876121 tempest-ServerDiskConfigTestJSON-536876121-project-member] Enqueued Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1117.010198] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1117.010198] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.010198] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.010198] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.010372] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.010487] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.010570] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.010608] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.010755] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.010839] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.010930] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.267647] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-194 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.267853] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-194" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.267981] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-194" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.268273] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-194" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.268534] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.268726] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.268855] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.269084] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.269239] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.269460] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1117.269582] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1117.269701] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1117.269814] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1117.269928] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1117.270051] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1117.270190] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1117.288757] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1117.288921] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1117.289075] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1117.289245] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-194" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.289538] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-ff971a6c-7fab-4c04-a75d-259986b9fce0 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.289708] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-ff971a6c-7fab-4c04-a75d-259986b9fce0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.289832] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-ff971a6c-7fab-4c04-a75d-259986b9fce0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.290171] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-ff971a6c-7fab-4c04-a75d-259986b9fce0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.290313] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff971a6c-7fab-4c04-a75d-259986b9fce0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.515540] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.515733] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.515775] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.515997] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.516115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.516335] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.516441] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.516491] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.516650] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.516728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.516816] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f8a4673-59c5-493b-8250-617958bf996b is going to be updated. [ 1117.543054] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.543054] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.543054] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.543054] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.543054] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.551809] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: IN_PROGRESS for 2s [ 1117.792058] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.792310] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.792444] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.793044] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.793270] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.793442] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port ff971a6c-7fab-4c04-a75d-259986b9fce0 not found, creating... [ 1117.793710] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.793894] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.794028] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.794284] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.794429] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.794728] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.794907] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.795039] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.795293] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.795526] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.795675] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: ff971a6c-7fab-4c04-a75d-259986b9fce0 is going to be created. [ 1117.816997] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.817212] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.817344] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.817603] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.817859] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.818090] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-ff971a6c-7fab-4c04-a75d-259986b9fce0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.495299] env[70013]: INFO networking_nsxv3.common.synchronization [req-bd4e1eb0-4528-4421-8a36-d1c9bf1e3c84 req-6e8ef717-30c2-40e7-97cc-c7b02c6bff74 service nova] Enqueued Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_rules [ 1118.495565] env[70013]: INFO networking_nsxv3.common.synchronization [req-bd4e1eb0-4528-4421-8a36-d1c9bf1e3c84 req-6e8ef717-30c2-40e7-97cc-c7b02c6bff74 service nova] Enqueued Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1118.496573] env[70013]: INFO networking_nsxv3.common.synchronization [req-bd4e1eb0-4528-4421-8a36-d1c9bf1e3c84 req-6e8ef717-30c2-40e7-97cc-c7b02c6bff74 service nova] Enqueued Resource ID: ff971a6c-7fab-4c04-a75d-259986b9fce0 with Priority: HIGHEST for action port [ 1118.496573] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_rules [ 1118.496573] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1118.496573] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff971a6c-7fab-4c04-a75d-259986b9fce0 with Priority: HIGHEST for action port [ 1118.497117] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.497309] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.497501] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.497964] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.497964] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.498980] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.498980] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.499261] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff971a6c-7fab-4c04-a75d-259986b9fce0 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.499408] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff971a6c-7fab-4c04-a75d-259986b9fce0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.499530] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff971a6c-7fab-4c04-a75d-259986b9fce0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.499754] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff971a6c-7fab-4c04-a75d-259986b9fce0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.499878] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff971a6c-7fab-4c04-a75d-259986b9fce0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.002064] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.002257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.002459] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff971a6c-7fab-4c04-a75d-259986b9fce0 with status ACTIVE [ 1119.002686] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.002823] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.002912] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.003215] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.003407] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.003606] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.003737] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.003825] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.004082] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.004192] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.004453] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.004613] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.004661] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.004854] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.004954] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.005078] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff971a6c-7fab-4c04-a75d-259986b9fce0 is going to be updated. [ 1119.027293] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.027546] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.027684] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.027987] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.028226] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.028469] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff971a6c-7fab-4c04-a75d-259986b9fce0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.560687] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: SUCCESS [ 1119.560972] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f8a4673-59c5-493b-8250-617958bf996b deletion is rescheduled due to dependency. [ 1119.560972] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.561153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.561356] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.561537] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.561652] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.561718] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.561871] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.561950] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.562059] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.063924] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.567740] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.069977] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.070108] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.070108] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.070338] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.070444] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.070566] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f8a4673-59c5-493b-8250-617958bf996b is going to be updated. [ 1121.098337] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.098495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.098545] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.098746] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.098892] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.106864] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: IN_PROGRESS for 2s [ 1122.856641] env[70013]: INFO networking_nsxv3.common.synchronization [req-6b338387-68f8-4112-9a07-76d8c982e748 req-6ab3ef04-2a8a-435a-acbd-eb86adcc49e7 tempest-DeleteServersTestJSON-1971284771 tempest-DeleteServersTestJSON-1971284771-project-member] Enqueued Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 1122.857089] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 1122.857398] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.857526] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.857593] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.857791] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.857936] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.858044] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.858110] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.858257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.858344] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.858478] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.118437] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: IN_PROGRESS for 4s [ 1123.161283] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-446 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.161283] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-446" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.161283] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-446" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.161283] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-446" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.161283] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.161283] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.161283] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.161283] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.161283] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.162524] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1123.162780] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1123.162984] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1123.163216] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1123.163454] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1123.163791] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1123.164028] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1123.182396] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1123.182583] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1123.182728] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1123.182922] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-446" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.183813] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-4332b789-1993-4df4-8099-15089bf507db taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.183989] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-4332b789-1993-4df4-8099-15089bf507db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.184208] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-4332b789-1993-4df4-8099-15089bf507db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.184583] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-4332b789-1993-4df4-8099-15089bf507db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.185104] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4332b789-1993-4df4-8099-15089bf507db',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.361151] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.361354] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.361438] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.361594] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.361688] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.361884] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.361979] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.362054] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.362200] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.362271] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.362359] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b is going to be updated. [ 1123.386904] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.387049] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.387140] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.387310] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.387450] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.394961] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: IN_PROGRESS for 2s [ 1123.688258] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.688490] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.688624] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.688915] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.689087] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.689246] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 4332b789-1993-4df4-8099-15089bf507db not found, creating... [ 1123.689502] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.689664] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.689786] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.690015] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.690163] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.690446] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.690606] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.690727] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.690938] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.691084] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.691228] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 4332b789-1993-4df4-8099-15089bf507db is going to be created. [ 1123.722494] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.722697] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.722824] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.723133] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.723390] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.723615] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-4332b789-1993-4df4-8099-15089bf507db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.252289] env[70013]: INFO networking_nsxv3.common.synchronization [req-f3930ad2-4c80-4d81-9576-5719a28ab5a2 req-c2631e75-03b6-4cb5-885f-0b919ad23fab tempest-AttachInterfacesTestJSON-1580231832 tempest-AttachInterfacesTestJSON-1580231832-project-member] Enqueued Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_members [ 1124.252815] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_members [ 1124.253101] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.253323] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.253323] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.255441] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.255441] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.255441] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.255441] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.255441] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.255441] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.255441] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.438995] env[70013]: INFO networking_nsxv3.common.synchronization [req-6b338387-68f8-4112-9a07-76d8c982e748 req-9120aeed-59cf-4d8f-bf03-68fd78284c84 service nova] Enqueued Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_rules [ 1124.439185] env[70013]: INFO networking_nsxv3.common.synchronization [req-6b338387-68f8-4112-9a07-76d8c982e748 req-9120aeed-59cf-4d8f-bf03-68fd78284c84 service nova] Enqueued Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 1124.439356] env[70013]: INFO networking_nsxv3.common.synchronization [req-6b338387-68f8-4112-9a07-76d8c982e748 req-9120aeed-59cf-4d8f-bf03-68fd78284c84 service nova] Enqueued Resource ID: 4332b789-1993-4df4-8099-15089bf507db with Priority: HIGHEST for action port [ 1124.439606] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_rules [ 1124.439746] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 1124.439871] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4332b789-1993-4df4-8099-15089bf507db with Priority: HIGHEST for action port [ 1124.440700] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.440865] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.440985] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.441248] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.441376] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.442719] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.442719] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.442983] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-4332b789-1993-4df4-8099-15089bf507db taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.443150] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4332b789-1993-4df4-8099-15089bf507db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.443263] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4332b789-1993-4df4-8099-15089bf507db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.443503] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4332b789-1993-4df4-8099-15089bf507db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.443642] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4332b789-1993-4df4-8099-15089bf507db',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.757927] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.757927] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.757927] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.758209] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.758209] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.758288] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.758393] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.758455] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.758606] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.758678] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.758989] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 is going to be updated. [ 1124.785046] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.785046] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.785046] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.785255] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.785287] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.793349] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: IN_PROGRESS for 2s [ 1124.946332] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.946332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.946332] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4332b789-1993-4df4-8099-15089bf507db with status ACTIVE [ 1124.946332] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.946332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.946332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.946332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.946784] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.946784] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.946784] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.946784] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.946977] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.946977] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.947161] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.947270] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.947348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.947496] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.947574] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.947659] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4332b789-1993-4df4-8099-15089bf507db is going to be updated. [ 1124.966909] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.967088] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.967088] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.967276] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.967404] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.967566] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4332b789-1993-4df4-8099-15089bf507db" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.127467] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: SUCCESS [ 1125.127816] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.128019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.128237] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.128428] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.128546] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.128612] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.128763] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.128846] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.128929] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.129037] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.403497] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: SUCCESS [ 1125.403763] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b deletion is rescheduled due to dependency. [ 1125.403800] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.403941] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.404172] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.404519] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.404519] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.404519] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.404733] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.404784] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.404847] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.631026] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.631264] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.631344] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.631509] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.631679] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.631799] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.631858] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.631977] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.632094] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.632212] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.632375] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.632548] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.632548] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.632678] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.632825] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.632911] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.632972] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.633145] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.633227] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.633333] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.633479] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.909610] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.136258] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f8a4673-59c5-493b-8250-617958bf996b: rpc.has_security_group_logging(os_id): False [ 1126.157343] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.157498] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.157573] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.157807] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.157900] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.158135] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.158233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.158297] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.158447] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.158526] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.158705] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.158797] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.158859] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.158999] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.159086] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.159262] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.159353] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.159415] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.159553] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.159629] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.159713] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f8a4673-59c5-493b-8250-617958bf996b is going to be updated. [ 1126.219984] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.220214] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.220214] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.220372] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.220523] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.234860] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: IN_PROGRESS for 2s [ 1126.411635] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.802653] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: SUCCESS [ 1126.802947] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 deletion is rescheduled due to dependency. [ 1126.803054] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.913856] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.914103] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.914103] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.914325] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.914416] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.914515] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b is going to be updated. [ 1126.946027] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.946027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.946027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.946027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.946027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.952149] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: IN_PROGRESS for 2s [ 1127.345684] env[70013]: INFO networking_nsxv3.common.synchronization [req-d303fe78-1c34-475b-8067-bce2e43dfcc0 req-6b1973ed-cbb7-42ba-ae1e-0e323605ba8f tempest-AttachInterfacesTestJSON-1580231832 tempest-AttachInterfacesTestJSON-1580231832-project-member] Enqueued Resource ID: df2a8892-05ec-4200-8b30-e8813181f4e5 with Priority: HIGHEST for action security_group_members [ 1127.346243] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df2a8892-05ec-4200-8b30-e8813181f4e5 with Priority: HIGHEST for action security_group_members [ 1127.346581] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-df2a8892-05ec-4200-8b30-e8813181f4e5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.346705] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df2a8892-05ec-4200-8b30-e8813181f4e5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.347404] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df2a8892-05ec-4200-8b30-e8813181f4e5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.347404] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df2a8892-05ec-4200-8b30-e8813181f4e5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.347404] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.347404] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.347404] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.347744] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.347744] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.347744] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df2a8892-05ec-4200-8b30-e8813181f4e5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.849565] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.849831] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.849916] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.850102] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.871435] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.871830] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.871928] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.871974] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.872278] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.872364] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.872406] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df2a8892-05ec-4200-8b30-e8813181f4e5 is going to be updated. [ 1127.903034] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.903189] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.903233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.903506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.903652] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.911362] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df2a8892-05ec-4200-8b30-e8813181f4e5 in Status: IN_PROGRESS for 2s [ 1128.262060] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: SUCCESS [ 1128.262263] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.963222] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: SUCCESS [ 1128.963603] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.963693] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.963907] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.964115] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.964235] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.964300] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.964446] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.964527] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.964610] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.964703] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.467462] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.467659] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.467715] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.468043] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.468287] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.468427] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.468517] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.468731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.468843] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.468940] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.469103] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.469222] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.469304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.469485] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.469658] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.469811] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.469886] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.470042] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.470132] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.470240] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.470357] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.921402] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df2a8892-05ec-4200-8b30-e8813181f4e5 in Status: SUCCESS [ 1129.921596] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df2a8892-05ec-4200-8b30-e8813181f4e5 deletion is rescheduled due to dependency. [ 1129.921720] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df2a8892-05ec-4200-8b30-e8813181f4e5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.973574] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16c877e7-f731-49a5-b994-7d74c36c464b: rpc.has_security_group_logging(os_id): False [ 1129.988373] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.988373] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.988373] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.988578] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.988578] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.988777] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.988895] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.988961] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.989144] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.989225] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.989421] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.989518] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.989594] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.989742] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.989831] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.990044] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.990152] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.990216] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.990382] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.991018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.991018] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b is going to be updated. [ 1130.043614] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.043777] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.043851] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.044099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.044242] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.060756] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: IN_PROGRESS for 2s [ 1132.077231] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: SUCCESS [ 1132.077719] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.348058] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1132.348193] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1135.445606] env[70013]: INFO networking_nsxv3.common.synchronization [req-25e76371-c3ad-4a75-bfb4-ca621e6e06af req-49a7db47-cd80-46c4-b756-c63f0a460e29 tempest-ServersTestJSON-1543902807 tempest-ServersTestJSON-1543902807-project-member] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 1135.446181] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 1135.446495] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.446617] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.446682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.446877] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.447031] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.447126] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.447273] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.447332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.447415] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.447521] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.738685] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-250 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.738685] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-250" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.738685] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-250" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.738685] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-250" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.738685] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.738897] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.738934] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.741928] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.741928] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.741928] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1135.741928] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1135.741928] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1135.741928] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1135.741928] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1135.741928] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1135.741928] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1135.759026] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1135.759867] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1135.759867] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1135.759867] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-250" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.759867] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-7716680a-01d2-46d9-8812-272c03afab45 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.760134] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-7716680a-01d2-46d9-8812-272c03afab45" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.760134] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-7716680a-01d2-46d9-8812-272c03afab45" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.760441] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-7716680a-01d2-46d9-8812-272c03afab45" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.760590] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7716680a-01d2-46d9-8812-272c03afab45',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.949607] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.263381] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.263578] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.263578] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.263827] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.263985] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.264221] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 7716680a-01d2-46d9-8812-272c03afab45 not found, creating... [ 1136.264407] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.264566] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.264699] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.264924] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.265083] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.265647] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.265647] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.265910] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.265910] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.266070] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.266216] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 7716680a-01d2-46d9-8812-272c03afab45 is going to be created. [ 1136.284489] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.284677] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.284799] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.285048] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.285276] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.285548] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-7716680a-01d2-46d9-8812-272c03afab45" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.452258] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.954848] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.954990] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.955064] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.955288] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.955382] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.956022] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a is going to be updated. [ 1136.979543] env[70013]: INFO networking_nsxv3.common.synchronization [req-25e76371-c3ad-4a75-bfb4-ca621e6e06af req-cb775854-0a7b-444c-b5f5-f2de2062759b service nova] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_rules [ 1136.979765] env[70013]: INFO networking_nsxv3.common.synchronization [req-25e76371-c3ad-4a75-bfb4-ca621e6e06af req-cb775854-0a7b-444c-b5f5-f2de2062759b service nova] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 1136.979918] env[70013]: INFO networking_nsxv3.common.synchronization [req-25e76371-c3ad-4a75-bfb4-ca621e6e06af req-cb775854-0a7b-444c-b5f5-f2de2062759b service nova] Enqueued Resource ID: 7716680a-01d2-46d9-8812-272c03afab45 with Priority: HIGHEST for action port [ 1136.980248] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_rules [ 1136.980326] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 1136.980434] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7716680a-01d2-46d9-8812-272c03afab45 with Priority: HIGHEST for action port [ 1136.981324] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.981600] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.981754] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.982088] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.982266] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.983642] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.983642] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.983974] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-7716680a-01d2-46d9-8812-272c03afab45 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.984180] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7716680a-01d2-46d9-8812-272c03afab45" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.984303] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7716680a-01d2-46d9-8812-272c03afab45" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.984589] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7716680a-01d2-46d9-8812-272c03afab45" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.984711] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7716680a-01d2-46d9-8812-272c03afab45',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.986673] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.986875] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.987108] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.987208] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.988259] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.995618] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: IN_PROGRESS for 2s [ 1137.487119] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.487406] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.490051] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7716680a-01d2-46d9-8812-272c03afab45 with status ACTIVE [ 1137.490279] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.490413] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.490501] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.490735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.490831] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.491031] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.491133] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.491207] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.491376] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.491451] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.491644] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.491743] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.491815] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.491962] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.492069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.492156] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7716680a-01d2-46d9-8812-272c03afab45 is going to be updated. [ 1137.511018] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.511146] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.511229] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.511930] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.511930] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.511930] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7716680a-01d2-46d9-8812-272c03afab45" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.769285] env[70013]: INFO networking_nsxv3.common.synchronization [req-5746a2eb-4a68-4653-bfc3-47ab4eb7e1e9 req-5fa63027-0704-47f2-864e-91b8c0f460a0 tempest-ServerActionsTestJSON-1661939768 tempest-ServerActionsTestJSON-1661939768-project-member] Enqueued Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGHEST for action security_group_members [ 1137.769285] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGHEST for action security_group_members [ 1137.769667] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.769726] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.769762] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.769942] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.770157] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.770224] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.770261] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.770380] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.770472] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.770561] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.161845] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.162065] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-885" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.162194] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-885" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.162499] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-885" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.162768] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.162932] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.163479] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.163822] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.164057] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.164346] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1138.164529] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1138.164695] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1138.164857] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1138.165028] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1138.165197] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1138.165386] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1138.196739] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1138.197029] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1138.197186] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1138.197427] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-885" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.197767] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-6c9093b6-4b0e-4ac8-b1b1-4e54e43363a5 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.198029] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-6c9093b6-4b0e-4ac8-b1b1-4e54e43363a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.198209] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-6c9093b6-4b0e-4ac8-b1b1-4e54e43363a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.198596] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-6c9093b6-4b0e-4ac8-b1b1-4e54e43363a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.198781] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c9093b6-4b0e-4ac8-b1b1-4e54e43363a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.273088] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.273304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.273358] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.273632] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.273737] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.273942] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.274073] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.274122] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.274270] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.274351] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.274440] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 is going to be updated. [ 1138.304725] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.304893] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.304933] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.305155] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.305302] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.317447] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 in Status: IN_PROGRESS for 2s [ 1138.701648] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.702117] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.702195] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.702563] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.702792] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.703044] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 6c9093b6-4b0e-4ac8-b1b1-4e54e43363a5 not found, creating... [ 1138.703446] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.703681] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.703862] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.704196] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.704396] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.704818] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.705060] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.705244] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.705610] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.705736] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.705931] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 6c9093b6-4b0e-4ac8-b1b1-4e54e43363a5 is going to be created. [ 1138.737321] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.737590] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.737731] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.738043] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.738287] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.738519] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-6c9093b6-4b0e-4ac8-b1b1-4e54e43363a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.010435] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: SUCCESS [ 1139.010702] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.010916] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.011283] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.011374] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.011538] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.011626] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.011922] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.012674] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.012674] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.515011] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.794014] env[70013]: INFO networking_nsxv3.common.synchronization [req-5746a2eb-4a68-4653-bfc3-47ab4eb7e1e9 req-453abb43-0206-4c5c-b1dc-8fa86f22ca23 service nova] Enqueued Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGHEST for action security_group_rules [ 1139.794670] env[70013]: INFO networking_nsxv3.common.synchronization [req-5746a2eb-4a68-4653-bfc3-47ab4eb7e1e9 req-453abb43-0206-4c5c-b1dc-8fa86f22ca23 service nova] Enqueued Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGHEST for action security_group_members [ 1139.794921] env[70013]: INFO networking_nsxv3.common.synchronization [req-5746a2eb-4a68-4653-bfc3-47ab4eb7e1e9 req-453abb43-0206-4c5c-b1dc-8fa86f22ca23 service nova] Enqueued Resource ID: 6c9093b6-4b0e-4ac8-b1b1-4e54e43363a5 with Priority: HIGHEST for action port [ 1139.796053] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGHEST for action security_group_rules [ 1139.796462] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGHEST for action security_group_members [ 1139.796462] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c9093b6-4b0e-4ac8-b1b1-4e54e43363a5 with Priority: HIGHEST for action port [ 1139.796888] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.797168] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.797325] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.797708] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.797901] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.799422] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.799582] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.799912] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c9093b6-4b0e-4ac8-b1b1-4e54e43363a5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.800143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c9093b6-4b0e-4ac8-b1b1-4e54e43363a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.800315] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c9093b6-4b0e-4ac8-b1b1-4e54e43363a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.800615] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c9093b6-4b0e-4ac8-b1b1-4e54e43363a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.800699] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c9093b6-4b0e-4ac8-b1b1-4e54e43363a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.010199] env[70013]: INFO networking_nsxv3.common.synchronization [None req-f32612a9-5f1c-4941-be55-473a6e3787d2 tempest-AttachInterfacesTestJSON-1580231832 tempest-AttachInterfacesTestJSON-1580231832-project-member] Enqueued Resource ID: d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de with Priority: HIGHEST for action security_group_rules [ 1140.010490] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de with Priority: HIGHEST for action security_group_rules [ 1140.010807] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.010933] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.011011] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.011568] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.011718] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.021495] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.137851] env[70013]: INFO networking_nsxv3.common.synchronization [None req-e87f70b7-613e-457e-a97a-abf14231376b tempest-AttachInterfacesTestJSON-1580231832 tempest-AttachInterfacesTestJSON-1580231832-project-member] Enqueued Resource ID: d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de with Priority: HIGHEST for action security_group_rules [ 1140.137851] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de with Priority: HIGHEST for action security_group_rules [ 1140.137851] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.137851] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.302796] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.302985] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.304346] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c9093b6-4b0e-4ac8-b1b1-4e54e43363a5 with status ACTIVE [ 1140.304646] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.304815] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.304893] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.305132] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.305226] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.305402] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.305498] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.305582] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.305753] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.305839] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.306074] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.306179] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.306243] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.306389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.306466] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.306578] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c9093b6-4b0e-4ac8-b1b1-4e54e43363a5 is going to be updated. [ 1140.327342] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.327622] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.327808] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.328150] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.328309] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.328526] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c9093b6-4b0e-4ac8-b1b1-4e54e43363a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.329375] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 in Status: SUCCESS [ 1140.329714] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 deletion is rescheduled due to dependency. [ 1140.329714] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.329934] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.330213] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.330519] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.330659] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.330793] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.330994] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.331142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.331326] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.524144] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.524317] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.524371] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.524584] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.524754] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.524859] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a is going to be updated. [ 1140.552421] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.552421] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.552421] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.552644] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.552644] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.552701] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de already deleted. [ 1140.553838] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.553838] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.553838] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.553838] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.584141] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.584296] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.584365] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.584558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.584887] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.593954] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: IN_PROGRESS for 2s [ 1140.834051] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.073285] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.073434] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.073506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.073768] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.073881] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.073984] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de already deleted. [ 1141.074085] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.337243] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.839571] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.839912] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.839912] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.840107] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.840215] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.840362] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 is going to be updated. [ 1141.871909] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.872142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.872261] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.872437] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.872651] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.881485] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 in Status: IN_PROGRESS for 2s [ 1142.604684] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: SUCCESS [ 1142.604684] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.604684] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.604684] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.604898] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.604956] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.604998] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.605145] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.605225] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.605310] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.605400] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.107410] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.107727] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.107727] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.107973] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.108249] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.108423] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.108542] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.110078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.110078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.110078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.110078] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.110078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.110078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.110078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.110078] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.110078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.110078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.110078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.110078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.110078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.110565] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.613135] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f422a68f-f64a-4d93-9deb-289ae02aea3a: rpc.has_security_group_logging(os_id): False [ 1143.630123] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.630306] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.630407] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.630653] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.648727] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.649045] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.649196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.649284] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.649451] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.649543] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.649708] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.649805] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.649879] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.650073] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.650203] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.650400] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.650505] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.650557] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.650698] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.650778] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.650873] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a is going to be updated. [ 1143.710631] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.710858] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.710977] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.711305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.711542] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.723252] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: IN_PROGRESS for 2s [ 1143.891598] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 in Status: SUCCESS [ 1143.891598] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.891884] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.891997] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.892213] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.892335] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.892401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.892560] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.892645] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.892730] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.892825] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.395875] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.898142] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6: rpc.has_security_group_logging(os_id): False [ 1144.916079] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.916257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.916340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.916566] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.916696] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.917015] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.917102] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.917185] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.917307] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.917385] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.917483] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 is going to be updated. [ 1144.970760] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.970962] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.971081] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.971355] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.971541] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.983646] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 in Status: IN_PROGRESS for 2s [ 1145.137951] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1145.138164] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1145.736578] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: SUCCESS [ 1145.736962] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.996506] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 in Status: SUCCESS [ 1146.996937] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.569985] env[70013]: INFO networking_nsxv3.common.synchronization [req-d9aa6f3b-1d28-474b-8fdb-c1f2b4979b1f req-dfd5eb04-9e54-4e0d-a9db-a810d13b33b9 tempest-AttachInterfacesTestJSON-1580231832 tempest-AttachInterfacesTestJSON-1580231832-project-member] Enqueued Resource ID: d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de with Priority: HIGHEST for action security_group_members [ 1148.570871] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de with Priority: HIGHEST for action security_group_members [ 1148.571328] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.571490] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.571585] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.571920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.572151] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.572286] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.572375] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.572571] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.572686] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.572809] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.008023] env[70013]: INFO networking_nsxv3.common.synchronization [req-e2e55643-1cfd-4f61-accb-f43cef2abc6e req-14f21005-0f9e-4eff-9b0c-61bedc61d1c6 tempest-ServersTestJSON-1543902807 tempest-ServersTestJSON-1543902807-project-member] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 1149.008558] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 1149.008918] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.009071] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.009138] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.009361] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.009515] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.009613] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.009678] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.009833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.009916] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.010019] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.048383] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.048594] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.048734] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.049008] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.049287] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.049452] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.049575] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.049978] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.050199] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.050448] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1149.050546] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1149.050699] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1149.050777] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1149.051161] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1149.051350] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1149.051503] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1149.073784] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1149.073913] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1149.074073] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1149.074258] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.074567] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-0c413503-8ce1-454a-a6b0-3fb75d647a04 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.074744] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-0c413503-8ce1-454a-a6b0-3fb75d647a04" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.074871] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-0c413503-8ce1-454a-a6b0-3fb75d647a04" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.075227] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-0c413503-8ce1-454a-a6b0-3fb75d647a04" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.075371] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c413503-8ce1-454a-a6b0-3fb75d647a04',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.082473] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.082597] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.082674] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.082889] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.083008] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.083272] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.083387] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.083387] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.083544] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.083633] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.083720] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de already deleted. [ 1149.083814] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.512326] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.578563] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.578903] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.578956] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.579224] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.579376] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.579537] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 0c413503-8ce1-454a-a6b0-3fb75d647a04 not found, creating... [ 1149.579795] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.579962] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.580097] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.580321] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.580459] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.580740] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.580973] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.581065] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.581347] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.581532] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.581683] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 0c413503-8ce1-454a-a6b0-3fb75d647a04 is going to be created. [ 1149.601741] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.601844] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.601904] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.602192] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.602428] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.602704] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-0c413503-8ce1-454a-a6b0-3fb75d647a04" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.015174] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.274112] env[70013]: INFO networking_nsxv3.common.synchronization [req-d9aa6f3b-1d28-474b-8fdb-c1f2b4979b1f req-bf8b3e03-0a9b-4dc8-8904-c08e0947d950 service nova] Enqueued Resource ID: d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de with Priority: HIGHEST for action security_group_rules [ 1150.274297] env[70013]: INFO networking_nsxv3.common.synchronization [req-d9aa6f3b-1d28-474b-8fdb-c1f2b4979b1f req-bf8b3e03-0a9b-4dc8-8904-c08e0947d950 service nova] Enqueued Resource ID: d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de with Priority: HIGHEST for action security_group_members [ 1150.274443] env[70013]: INFO networking_nsxv3.common.synchronization [req-d9aa6f3b-1d28-474b-8fdb-c1f2b4979b1f req-bf8b3e03-0a9b-4dc8-8904-c08e0947d950 service nova] Enqueued Resource ID: 0c413503-8ce1-454a-a6b0-3fb75d647a04 with Priority: HIGHEST for action port [ 1150.274936] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de with Priority: HIGHEST for action security_group_rules [ 1150.275086] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de with Priority: HIGHEST for action security_group_members [ 1150.275184] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c413503-8ce1-454a-a6b0-3fb75d647a04 with Priority: HIGHEST for action port [ 1150.275464] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.275589] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.275692] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.277111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.277111] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.277414] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.277414] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.277414] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.277578] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.279728] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.279728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.279728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.279728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.279728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.279728] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.279728] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c413503-8ce1-454a-a6b0-3fb75d647a04 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.279728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c413503-8ce1-454a-a6b0-3fb75d647a04" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.279728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c413503-8ce1-454a-a6b0-3fb75d647a04" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.279728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c413503-8ce1-454a-a6b0-3fb75d647a04" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.279728] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c413503-8ce1-454a-a6b0-3fb75d647a04',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.517808] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.517991] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.518057] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.518278] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.518370] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.518472] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a is going to be updated. [ 1150.545220] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.545312] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.545356] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.545571] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.545802] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.555194] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: IN_PROGRESS for 2s [ 1150.782038] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.782809] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.782809] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.782809] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0c413503-8ce1-454a-a6b0-3fb75d647a04 with status ACTIVE [ 1150.782975] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.783125] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.783168] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.783359] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.783447] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.783670] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.783802] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.783802] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.783964] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.784063] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.784257] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.784367] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.784419] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.784561] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.784639] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.784750] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0c413503-8ce1-454a-a6b0-3fb75d647a04 is going to be updated. [ 1150.803657] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.803850] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.803950] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.804187] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.804358] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.804541] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c413503-8ce1-454a-a6b0-3fb75d647a04" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.286610] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.790056] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.790056] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.790056] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.790056] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.790544] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.790544] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de is going to be created. [ 1151.812435] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.812590] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.812641] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.812833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.812988] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.821099] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de in Status: UNINITIALIZED for 2s [ 1152.565475] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: SUCCESS [ 1152.565746] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.831239] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de in Status: SUCCESS [ 1153.831572] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.831609] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.831846] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.832048] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.832167] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.832230] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.832406] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.832490] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.832577] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.832666] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.335451] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.837939] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de: rpc.has_security_group_logging(os_id): False [ 1154.856927] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.857331] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.857331] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.857429] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.857471] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.857679] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.857780] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.857845] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.858028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.858112] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.858201] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de is going to be created. [ 1154.914786] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.914942] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.915022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.915292] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.915473] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.926492] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de in Status: IN_PROGRESS for 2s [ 1155.276377] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1155.276484] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1156.939056] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de in Status: SUCCESS [ 1156.939433] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.189196] env[70013]: INFO networking_nsxv3.common.synchronization [req-33faa09d-90c7-4b4c-bc0b-ac9c8d2406ed req-ba2c9416-91c0-4f2f-ba80-94e1aca99021 tempest-ServersTestJSON-1543902807 tempest-ServersTestJSON-1543902807-project-member] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 1160.189882] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 1160.190133] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.190275] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.190357] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.190597] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.190746] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.190876] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.190956] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.191162] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.191329] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.191377] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.463664] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-250 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.465055] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-250" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.465055] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-250" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.465055] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-250" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.465055] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.465359] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.465433] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.465802] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.465936] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.466199] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1160.466347] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1160.466476] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1160.466593] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1160.466771] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1160.466869] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1160.466984] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1160.486699] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1160.486928] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1160.487100] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1160.487325] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-250" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.487786] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-fdf42d56-b2c8-46af-be73-f38818a96a46 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.487951] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-fdf42d56-b2c8-46af-be73-f38818a96a46" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.488090] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-fdf42d56-b2c8-46af-be73-f38818a96a46" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.488473] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-fdf42d56-b2c8-46af-be73-f38818a96a46" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.488622] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdf42d56-b2c8-46af-be73-f38818a96a46',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.694805] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.894906] env[70013]: INFO networking_nsxv3.common.synchronization [req-57520b71-311e-44cd-8fdb-c83729d6aa46 req-c8663b99-6ecf-4dd0-9060-e7f81ac6de93 tempest-AttachVolumeNegativeTest-680083968 tempest-AttachVolumeNegativeTest-680083968-project-member] Enqueued Resource ID: 9378f72e-568d-4e53-8f92-4547bbc2beb3 with Priority: HIGHEST for action security_group_members [ 1160.894906] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9378f72e-568d-4e53-8f92-4547bbc2beb3 with Priority: HIGHEST for action security_group_members [ 1160.894906] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-9378f72e-568d-4e53-8f92-4547bbc2beb3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.895601] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.895601] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.895601] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.896511] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.896511] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.896511] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.896689] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.896920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.896920] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9378f72e-568d-4e53-8f92-4547bbc2beb3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.993119] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.993362] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.993490] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.993794] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.993970] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.995014] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port fdf42d56-b2c8-46af-be73-f38818a96a46 not found, creating... [ 1160.995014] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.995014] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.995014] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.995014] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.995446] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.995446] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.995553] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.995675] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.995950] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.996111] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.996257] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: fdf42d56-b2c8-46af-be73-f38818a96a46 is going to be created. [ 1161.017268] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.017268] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.017268] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.017268] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.017268] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.017268] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-fdf42d56-b2c8-46af-be73-f38818a96a46" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.197289] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.398909] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.399127] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.399179] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.399378] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.399472] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.399670] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.399770] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.399834] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.399987] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.400082] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.400170] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9378f72e-568d-4e53-8f92-4547bbc2beb3 is going to be updated. [ 1161.431168] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.431340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.431393] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.431573] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.431762] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.440119] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9378f72e-568d-4e53-8f92-4547bbc2beb3 in Status: IN_PROGRESS for 2s [ 1161.702576] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.702576] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.702576] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.702576] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.702576] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.702576] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a is going to be updated. [ 1161.703900] env[70013]: INFO networking_nsxv3.common.synchronization [req-33faa09d-90c7-4b4c-bc0b-ac9c8d2406ed req-a0352c46-d734-410f-b955-b5353b23df35 service nova] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_rules [ 1161.704541] env[70013]: INFO networking_nsxv3.common.synchronization [req-33faa09d-90c7-4b4c-bc0b-ac9c8d2406ed req-a0352c46-d734-410f-b955-b5353b23df35 service nova] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 1161.704541] env[70013]: INFO networking_nsxv3.common.synchronization [req-33faa09d-90c7-4b4c-bc0b-ac9c8d2406ed req-a0352c46-d734-410f-b955-b5353b23df35 service nova] Enqueued Resource ID: fdf42d56-b2c8-46af-be73-f38818a96a46 with Priority: HIGHEST for action port [ 1161.704952] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_rules [ 1161.705951] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 1161.705951] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdf42d56-b2c8-46af-be73-f38818a96a46 with Priority: HIGHEST for action port [ 1161.707444] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.708037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.708291] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.708649] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.708745] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.710202] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.710290] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.710495] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-fdf42d56-b2c8-46af-be73-f38818a96a46 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.710592] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fdf42d56-b2c8-46af-be73-f38818a96a46" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.710653] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fdf42d56-b2c8-46af-be73-f38818a96a46" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.710988] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fdf42d56-b2c8-46af-be73-f38818a96a46" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.711086] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdf42d56-b2c8-46af-be73-f38818a96a46',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.750806] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.750941] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.751031] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.751249] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.751395] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.762490] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: IN_PROGRESS for 2s [ 1162.211492] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.211772] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.214029] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fdf42d56-b2c8-46af-be73-f38818a96a46 with status ACTIVE [ 1162.214029] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.214029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.214029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.214029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.214029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.214029] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.214363] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.214363] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.214363] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.214460] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.214641] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.214740] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.214804] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.214954] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.215042] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.215128] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fdf42d56-b2c8-46af-be73-f38818a96a46 is going to be updated. [ 1162.238716] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.238850] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.238923] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.239129] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.239261] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.239414] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fdf42d56-b2c8-46af-be73-f38818a96a46" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.451645] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9378f72e-568d-4e53-8f92-4547bbc2beb3 in Status: SUCCESS [ 1163.451645] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9378f72e-568d-4e53-8f92-4547bbc2beb3 deletion is rescheduled due to dependency. [ 1163.451645] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.775058] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: SUCCESS [ 1163.775058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.775058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.775058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.775058] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.775058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.775058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.775058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.775058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.775058] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.277658] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.779589] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.282080] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.282277] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.282342] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.282559] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.282651] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.282751] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a is going to be updated. [ 1165.310990] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.311186] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.311233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.311424] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.311571] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.321094] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: IN_PROGRESS for 2s [ 1165.357026] env[70013]: INFO networking_nsxv3.common.synchronization [None req-092eaeab-7946-49cf-86bd-7430805be2d7 tempest-ServerDiskConfigTestJSON-536876121 tempest-ServerDiskConfigTestJSON-536876121-project-member] Enqueued Resource ID: 48d96249-2c27-45df-a2db-c97fb429bd43 with Priority: HIGHEST for action security_group_rules [ 1165.357761] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d96249-2c27-45df-a2db-c97fb429bd43 with Priority: HIGHEST for action security_group_rules [ 1165.358692] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48d96249-2c27-45df-a2db-c97fb429bd43 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.358898] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48d96249-2c27-45df-a2db-c97fb429bd43" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.359062] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48d96249-2c27-45df-a2db-c97fb429bd43" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.359395] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48d96249-2c27-45df-a2db-c97fb429bd43" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.359532] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48d96249-2c27-45df-a2db-c97fb429bd43',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.481034] env[70013]: INFO networking_nsxv3.common.synchronization [None req-88e56c3f-1cf9-4c52-8ca5-e6a7246ffea0 tempest-ServerDiskConfigTestJSON-536876121 tempest-ServerDiskConfigTestJSON-536876121-project-member] Enqueued Resource ID: 48d96249-2c27-45df-a2db-c97fb429bd43 with Priority: HIGHEST for action security_group_rules [ 1165.481477] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48d96249-2c27-45df-a2db-c97fb429bd43 with Priority: HIGHEST for action security_group_rules [ 1165.481790] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-48d96249-2c27-45df-a2db-c97fb429bd43 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.481896] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-48d96249-2c27-45df-a2db-c97fb429bd43" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.880471] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.880813] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.880813] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.880978] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.881281] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.881281] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48d96249-2c27-45df-a2db-c97fb429bd43 already deleted. [ 1165.881281] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48d96249-2c27-45df-a2db-c97fb429bd43" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.881432] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-48d96249-2c27-45df-a2db-c97fb429bd43" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.881614] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-48d96249-2c27-45df-a2db-c97fb429bd43" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.881702] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('48d96249-2c27-45df-a2db-c97fb429bd43',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.402675] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.402875] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.402875] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.403319] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.403319] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.403492] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 48d96249-2c27-45df-a2db-c97fb429bd43 already deleted. [ 1166.403492] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-48d96249-2c27-45df-a2db-c97fb429bd43" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.973024] env[70013]: INFO networking_nsxv3.common.synchronization [None req-ec676431-b3b5-4e5a-8624-e5a2bad25651 tempest-AttachVolumeNegativeTest-680083968 tempest-AttachVolumeNegativeTest-680083968-project-member] Enqueued Resource ID: e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 with Priority: HIGHEST for action security_group_rules [ 1166.973439] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 with Priority: HIGHEST for action security_group_rules [ 1166.973842] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.973842] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.973983] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.974215] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.974377] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e56a9d58-7904-4a6e-8dc7-f39e99c54ed0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.039638] env[70013]: INFO networking_nsxv3.common.synchronization [None req-538e3171-cbcf-4108-8afb-04d66b98e257 tempest-AttachVolumeNegativeTest-680083968 tempest-AttachVolumeNegativeTest-680083968-project-member] Enqueued Resource ID: e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 with Priority: HIGHEST for action security_group_rules [ 1167.039934] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 with Priority: HIGHEST for action security_group_rules [ 1167.040278] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.040382] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.330978] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: SUCCESS [ 1167.331224] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.331407] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.331645] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.331865] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.332025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.332094] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.332262] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.332348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.332429] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.332536] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.494751] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.495039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.495039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.495285] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.495395] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.495510] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 already deleted. [ 1167.495596] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.495782] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.496115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.496241] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e56a9d58-7904-4a6e-8dc7-f39e99c54ed0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.834937] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.834937] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.834937] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.834937] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.835300] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.835300] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.835300] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.835425] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.835502] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.835592] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.835743] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.835886] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.835943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.836123] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.836279] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.836384] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.836446] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.836588] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.836664] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.836745] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.836835] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.015958] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.015958] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.016309] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.016309] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.016309] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.016401] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 already deleted. [ 1168.016550] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.338850] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f422a68f-f64a-4d93-9deb-289ae02aea3a: rpc.has_security_group_logging(os_id): False [ 1168.355761] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.355974] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.356056] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.356283] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.356376] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.356606] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.356704] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.356761] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.357197] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.357197] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.357197] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.357356] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.357356] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.357540] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.357540] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.357680] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.357818] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.357818] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.357954] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.358715] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.358846] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a is going to be updated. [ 1168.361968] env[70013]: INFO networking_nsxv3.common.synchronization [req-d369a7f0-3425-470f-97e8-9438ab70027c req-596db927-8d0c-426b-ba3b-40a0f431ee45 tempest-ServerDiskConfigTestJSON-536876121 tempest-ServerDiskConfigTestJSON-536876121-project-member] Enqueued Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1168.362641] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1168.363276] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.363393] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.363460] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.363616] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.363758] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.363852] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.363916] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.364070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.364149] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.364232] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.415777] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.416032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.416125] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.416367] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.416533] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.430196] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: IN_PROGRESS for 2s [ 1168.866426] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.866623] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.866681] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.866932] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.866988] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.867220] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.867295] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.867329] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.867527] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.867527] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.867614] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f8a4673-59c5-493b-8250-617958bf996b is going to be updated. [ 1168.893126] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.893288] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.893288] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.893544] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.893604] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.902520] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: IN_PROGRESS for 2s [ 1170.443525] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: SUCCESS [ 1170.443838] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.912957] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: SUCCESS [ 1170.912957] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f8a4673-59c5-493b-8250-617958bf996b deletion is rescheduled due to dependency. [ 1170.912957] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.294426] env[70013]: INFO networking_nsxv3.common.synchronization [req-73bee47a-40b1-4ec8-9bf8-0dd38d09980c req-cf4d4016-fdec-4012-a552-f1dccffcbd7f tempest-ServerDiskConfigTestJSON-536876121 tempest-ServerDiskConfigTestJSON-536876121-project-member] Enqueued Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1172.294998] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1172.295684] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.295843] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.295956] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.296204] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.296389] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.296537] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.296612] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.296789] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.296918] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.297048] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.760722] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-194 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.760722] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-194" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.760722] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-194" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.760722] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-194" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.760722] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.760722] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.760722] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.760722] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.761127] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.761127] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1172.761198] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1172.761281] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1172.761390] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1172.761503] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1172.761822] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1172.761876] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1172.767566] env[70013]: INFO networking_nsxv3.common.synchronization [req-b155af85-5adf-45f5-8b25-404413d45a7f req-0dc70101-a0d3-4642-b33d-6cddbd8836e7 tempest-DeleteServersTestJSON-1971284771 tempest-DeleteServersTestJSON-1971284771-project-member] Enqueued Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 1172.767820] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGHEST for action security_group_members [ 1172.768336] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.768451] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.768518] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.768783] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.768930] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.769037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.769100] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.769241] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.769325] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.769427] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.779359] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1172.779556] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1172.780160] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1172.780160] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-194" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.780160] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-2e2d4a2d-9a02-4d7e-b369-98b035a79190 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.780375] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-2e2d4a2d-9a02-4d7e-b369-98b035a79190" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.780413] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-2e2d4a2d-9a02-4d7e-b369-98b035a79190" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.780706] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-2e2d4a2d-9a02-4d7e-b369-98b035a79190" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.780839] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e2d4a2d-9a02-4d7e-b369-98b035a79190',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.799282] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.799412] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.799485] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.799683] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.799772] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.801047] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.801047] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.801047] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.801047] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.801047] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.801047] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f8a4673-59c5-493b-8250-617958bf996b is going to be updated. [ 1172.824659] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.825124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.825124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.825124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.825289] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.833333] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: IN_PROGRESS for 2s [ 1173.276530] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.277035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.277035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.277035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.277184] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.277283] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.277385] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.277442] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.277586] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.277699] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.277754] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b is going to be updated. [ 1173.285339] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.285553] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.285691] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.285948] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.286132] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.286279] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 2e2d4a2d-9a02-4d7e-b369-98b035a79190 not found, creating... [ 1173.286526] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.286687] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.286896] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.287118] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.287270] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.287558] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.287715] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.287832] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.288049] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.288221] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.288361] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 2e2d4a2d-9a02-4d7e-b369-98b035a79190 is going to be created. [ 1173.304321] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.304599] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.304599] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.304676] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.304772] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.309437] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.309604] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.309730] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.309949] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.310178] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.310377] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-2e2d4a2d-9a02-4d7e-b369-98b035a79190" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.312236] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: IN_PROGRESS for 2s [ 1174.107766] env[70013]: INFO networking_nsxv3.common.synchronization [req-73bee47a-40b1-4ec8-9bf8-0dd38d09980c req-96520af1-c44e-4bad-943d-6c95890a131b service nova] Enqueued Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_rules [ 1174.107766] env[70013]: INFO networking_nsxv3.common.synchronization [req-73bee47a-40b1-4ec8-9bf8-0dd38d09980c req-96520af1-c44e-4bad-943d-6c95890a131b service nova] Enqueued Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1174.107855] env[70013]: INFO networking_nsxv3.common.synchronization [req-73bee47a-40b1-4ec8-9bf8-0dd38d09980c req-96520af1-c44e-4bad-943d-6c95890a131b service nova] Enqueued Resource ID: 2e2d4a2d-9a02-4d7e-b369-98b035a79190 with Priority: HIGHEST for action port [ 1174.108347] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_rules [ 1174.108484] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1174.108583] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e2d4a2d-9a02-4d7e-b369-98b035a79190 with Priority: HIGHEST for action port [ 1174.108876] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.109011] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.109097] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.109341] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.109430] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.110270] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.110369] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.110562] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e2d4a2d-9a02-4d7e-b369-98b035a79190 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.110658] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e2d4a2d-9a02-4d7e-b369-98b035a79190" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.110740] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e2d4a2d-9a02-4d7e-b369-98b035a79190" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.110974] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e2d4a2d-9a02-4d7e-b369-98b035a79190" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.111015] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e2d4a2d-9a02-4d7e-b369-98b035a79190',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.614267] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e2d4a2d-9a02-4d7e-b369-98b035a79190 with status ACTIVE [ 1174.614503] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.614603] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.614646] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.614849] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.614941] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.615135] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.615234] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.615300] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.615444] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.615518] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.615701] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.615793] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.615854] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.616233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.616233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.616366] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e2d4a2d-9a02-4d7e-b369-98b035a79190 is going to be updated. [ 1174.617533] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.617644] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.635404] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.635557] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.635601] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.635761] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.636129] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.636129] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e2d4a2d-9a02-4d7e-b369-98b035a79190" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.698338] env[70013]: INFO networking_nsxv3.common.synchronization [req-15729399-d26c-4338-8ee5-019c58e0c012 req-9684ae7f-e2e6-4c68-9532-affd2080fa4d tempest-AttachVolumeNegativeTest-680083968 tempest-AttachVolumeNegativeTest-680083968-project-member] Enqueued Resource ID: e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 with Priority: HIGHEST for action security_group_members [ 1174.698876] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 with Priority: HIGHEST for action security_group_members [ 1174.699205] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.699347] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.699387] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.699722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.699885] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.700391] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.700461] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.700635] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.700861] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.700861] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e56a9d58-7904-4a6e-8dc7-f39e99c54ed0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.842563] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: SUCCESS [ 1174.842757] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f8a4673-59c5-493b-8250-617958bf996b deletion is rescheduled due to dependency. [ 1174.842864] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.843034] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.843259] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.843449] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.843569] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.843627] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.846672] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.846672] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.846672] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.041337] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-145 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.041337] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-145" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.043049] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-145" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.043049] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-145" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.043049] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.043049] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.043049] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.043049] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.043049] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.043049] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1175.043336] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1175.043336] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1175.043336] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1175.043418] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1175.043693] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1175.043693] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1175.062821] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1175.062948] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1175.063016] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1175.063234] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-145" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.063608] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-f17543b2-5415-422a-b395-b7aa575543a0 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.063860] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-f17543b2-5415-422a-b395-b7aa575543a0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.063945] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-f17543b2-5415-422a-b395-b7aa575543a0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.064304] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-f17543b2-5415-422a-b395-b7aa575543a0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.064466] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f17543b2-5415-422a-b395-b7aa575543a0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.203453] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.203619] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.203701] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.203946] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.204061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.204264] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.204362] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.204426] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.204622] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.204712] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.204800] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 already deleted. [ 1175.204884] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.320968] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16c877e7-f731-49a5-b994-7d74c36c464b in Status: SUCCESS [ 1175.321131] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b deletion is rescheduled due to dependency. [ 1175.321272] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.348483] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.566657] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.566922] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.567113] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.567444] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.567631] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.567825] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port f17543b2-5415-422a-b395-b7aa575543a0 not found, creating... [ 1175.568133] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.568392] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.568544] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.568828] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.569029] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.569367] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.569545] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.569688] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.569936] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.570115] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.570293] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: f17543b2-5415-422a-b395-b7aa575543a0 is going to be created. [ 1175.588298] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.588430] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.588521] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.588742] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.588968] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.589206] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-f17543b2-5415-422a-b395-b7aa575543a0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.851476] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.292722] env[70013]: INFO networking_nsxv3.common.synchronization [req-15729399-d26c-4338-8ee5-019c58e0c012 req-1b8606e8-7949-45c3-9008-b45fee3e0028 service nova] Enqueued Resource ID: e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 with Priority: HIGHEST for action security_group_rules [ 1176.292907] env[70013]: INFO networking_nsxv3.common.synchronization [req-15729399-d26c-4338-8ee5-019c58e0c012 req-1b8606e8-7949-45c3-9008-b45fee3e0028 service nova] Enqueued Resource ID: e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 with Priority: HIGHEST for action security_group_members [ 1176.293062] env[70013]: INFO networking_nsxv3.common.synchronization [req-15729399-d26c-4338-8ee5-019c58e0c012 req-1b8606e8-7949-45c3-9008-b45fee3e0028 service nova] Enqueued Resource ID: f17543b2-5415-422a-b395-b7aa575543a0 with Priority: HIGHEST for action port [ 1176.293304] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 with Priority: HIGHEST for action security_group_rules [ 1176.293434] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 with Priority: HIGHEST for action security_group_members [ 1176.293534] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f17543b2-5415-422a-b395-b7aa575543a0 with Priority: HIGHEST for action port [ 1176.294311] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.294396] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.294458] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.294664] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.295086] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e56a9d58-7904-4a6e-8dc7-f39e99c54ed0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.296418] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.296418] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.296418] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.296418] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.296418] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.296418] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.296788] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.296788] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.296962] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.297032] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e56a9d58-7904-4a6e-8dc7-f39e99c54ed0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.297780] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-f17543b2-5415-422a-b395-b7aa575543a0 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.297918] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f17543b2-5415-422a-b395-b7aa575543a0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.298287] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f17543b2-5415-422a-b395-b7aa575543a0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.298977] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f17543b2-5415-422a-b395-b7aa575543a0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.299118] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f17543b2-5415-422a-b395-b7aa575543a0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.353725] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.353904] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.353978] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.354197] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.354289] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.354384] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f8a4673-59c5-493b-8250-617958bf996b is going to be updated. [ 1176.379852] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.379991] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.380069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.380276] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.380418] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.390134] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: IN_PROGRESS for 2s [ 1176.801517] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e56a9d58-7904-4a6e-8dc7-f39e99c54ed0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.802942] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.803061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.803252] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f17543b2-5415-422a-b395-b7aa575543a0 with status ACTIVE [ 1176.803414] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.803519] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.803584] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.803783] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.803873] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.804054] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.804376] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.804376] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.804376] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.804515] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.804611] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.804723] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.804786] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.804893] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.806360] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.806360] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f17543b2-5415-422a-b395-b7aa575543a0 is going to be updated. [ 1176.824219] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.824345] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.824440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.824681] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.824851] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.825022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f17543b2-5415-422a-b395-b7aa575543a0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.254781] env[70013]: INFO networking_nsxv3.common.synchronization [req-9694468b-eb56-40f0-a3e1-341e4fec4482 req-c3ea2724-c924-400b-9768-058c7d96b4c5 tempest-ServersTestJSON-1543902807 tempest-ServersTestJSON-1543902807-project-member] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 1177.255323] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 1177.255604] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.255728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.255797] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.256150] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.256321] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.256429] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.256505] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.256668] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.256756] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.256846] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.307027] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e56a9d58-7904-4a6e-8dc7-f39e99c54ed0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.759066] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.809221] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.809385] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.809467] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.809667] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.809758] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.809855] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 is going to be created. [ 1177.832556] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.832723] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.832723] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.833070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.833644] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.845773] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 in Status: UNINITIALIZED for 2s [ 1178.261021] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.399013] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: SUCCESS [ 1178.399628] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.399628] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.399802] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.399853] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.399953] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.400020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.400182] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.400281] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.400369] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.400464] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.764191] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.764343] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.764419] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.764725] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.764891] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.765052] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a is going to be updated. [ 1178.812234] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.812389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.812448] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.812678] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.812836] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.825917] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: IN_PROGRESS for 2s [ 1178.903261] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.903430] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.903506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.903711] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.903885] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.904037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.904109] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.904214] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.904307] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.904397] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.904547] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.904640] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.904703] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.904844] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.904995] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.905129] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.905190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.905336] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.905412] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.905495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.905588] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.411421] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f8a4673-59c5-493b-8250-617958bf996b: rpc.has_security_group_logging(os_id): False [ 1179.430059] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.430211] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.430410] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.430532] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.430631] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.430870] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.430980] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.431083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.431246] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.431326] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.431712] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.431712] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.431712] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.431869] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.431869] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.432031] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.432123] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.432184] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.432323] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.432397] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.432481] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f8a4673-59c5-493b-8250-617958bf996b is going to be updated. [ 1179.488895] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.489070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.489166] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.489387] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.489535] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.500690] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: IN_PROGRESS for 2s [ 1179.855907] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 in Status: SUCCESS [ 1179.856565] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.856761] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.857445] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.857687] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.857822] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.857897] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.858091] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.858368] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.858368] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.858368] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e56a9d58-7904-4a6e-8dc7-f39e99c54ed0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.361052] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e56a9d58-7904-4a6e-8dc7-f39e99c54ed0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.834454] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: SUCCESS [ 1180.834763] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.870700] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e56a9d58-7904-4a6e-8dc7-f39e99c54ed0: rpc.has_security_group_logging(os_id): False [ 1180.889397] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.889540] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.889613] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.889832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.889925] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.890184] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.890280] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.890348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.890495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.891500] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.891500] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 is going to be created. [ 1180.944811] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.944965] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.945053] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.945281] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.945786] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.957666] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 in Status: IN_PROGRESS for 2s [ 1181.518893] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: SUCCESS [ 1181.519134] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.685090] env[70013]: INFO networking_nsxv3.common.synchronization [req-d50d0520-e4cf-4ce8-8d13-65957dc64986 req-f3dda100-8d59-4bd5-9bba-a2d1dd4f9652 tempest-ServerActionsTestOtherA-108106573 tempest-ServerActionsTestOtherA-108106573-project-member] Enqueued Resource ID: e555b24f-3b58-40b7-8837-06aac9343ba3 with Priority: HIGHEST for action security_group_members [ 1181.685722] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e555b24f-3b58-40b7-8837-06aac9343ba3 with Priority: HIGHEST for action security_group_members [ 1181.686504] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-e555b24f-3b58-40b7-8837-06aac9343ba3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.686504] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e555b24f-3b58-40b7-8837-06aac9343ba3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.686504] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e555b24f-3b58-40b7-8837-06aac9343ba3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.686504] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e555b24f-3b58-40b7-8837-06aac9343ba3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.686504] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.687341] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.687341] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.687341] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.687341] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.687341] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e555b24f-3b58-40b7-8837-06aac9343ba3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.191284] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.191284] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.191284] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.191284] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.215514] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.215514] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.215514] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.215514] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.215514] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.215514] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.215514] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e555b24f-3b58-40b7-8837-06aac9343ba3 is going to be updated. [ 1182.237152] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.237326] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.237410] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.237576] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.237714] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.246532] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e555b24f-3b58-40b7-8837-06aac9343ba3 in Status: IN_PROGRESS for 2s [ 1182.969870] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 in Status: SUCCESS [ 1182.969870] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.400154] env[70013]: INFO networking_nsxv3.common.synchronization [None req-d9868a7a-5976-4899-b8f9-9121bdc2eee9 None None] Enqueued Resource ID: b9836c58-c85f-48cb-911c-874c0ffae541 with Priority: HIGHEST for action port [ 1183.400154] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9836c58-c85f-48cb-911c-874c0ffae541 with Priority: HIGHEST for action port [ 1183.400154] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9836c58-c85f-48cb-911c-874c0ffae541 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.400154] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9836c58-c85f-48cb-911c-874c0ffae541" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.400154] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9836c58-c85f-48cb-911c-874c0ffae541" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.400154] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9836c58-c85f-48cb-911c-874c0ffae541" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.400154] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9836c58-c85f-48cb-911c-874c0ffae541',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.767991] env[70013]: INFO networking_nsxv3.common.synchronization [req-c5dd6104-1e19-4d67-9b64-6584a241809a req-911f84c6-64da-4bc1-9702-2783517c7609 tempest-ServersTestJSON-1543902807 tempest-ServersTestJSON-1543902807-project-member] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 1183.768732] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGHEST for action security_group_members [ 1183.769173] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.769347] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.769445] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.769724] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.769912] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.770049] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.770133] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.770354] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.770462] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.770593] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.903416] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9836c58-c85f-48cb-911c-874c0ffae541 [ 1183.903663] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.903795] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.903910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.904113] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.904205] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.904322] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9836c58-c85f-48cb-911c-874c0ffae541 already deleted. [ 1183.904415] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9836c58-c85f-48cb-911c-874c0ffae541" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.257077] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e555b24f-3b58-40b7-8837-06aac9343ba3 in Status: SUCCESS [ 1184.257927] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e555b24f-3b58-40b7-8837-06aac9343ba3 deletion is rescheduled due to dependency. [ 1184.257927] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e555b24f-3b58-40b7-8837-06aac9343ba3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.275967] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.275967] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.275967] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.275967] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.275967] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.275967] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.275967] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.275967] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.275967] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.275967] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.275967] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a is going to be updated. [ 1184.304560] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.304560] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.304560] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.304560] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.304560] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.310485] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: IN_PROGRESS for 2s [ 1185.951032] env[70013]: INFO networking_nsxv3.common.synchronization [None req-c212d440-7450-430f-80d7-82c074122f2e None None] Enqueued Resource ID: bd98c200-c28a-4226-af5b-615bddfe9981 with Priority: HIGHEST for action port [ 1185.951032] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd98c200-c28a-4226-af5b-615bddfe9981 with Priority: HIGHEST for action port [ 1185.951364] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd98c200-c28a-4226-af5b-615bddfe9981 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.951364] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd98c200-c28a-4226-af5b-615bddfe9981" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.951470] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd98c200-c28a-4226-af5b-615bddfe9981" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.951677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd98c200-c28a-4226-af5b-615bddfe9981" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.952077] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd98c200-c28a-4226-af5b-615bddfe9981',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.321645] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f422a68f-f64a-4d93-9deb-289ae02aea3a in Status: SUCCESS [ 1186.321784] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a deletion is rescheduled due to dependency. [ 1186.321902] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.454540] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bd98c200-c28a-4226-af5b-615bddfe9981 [ 1186.455273] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.455273] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.455273] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.455273] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.455273] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.455535] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bd98c200-c28a-4226-af5b-615bddfe9981 already deleted. [ 1186.455535] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd98c200-c28a-4226-af5b-615bddfe9981" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.951591] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1190.951970] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1194.893097] env[70013]: INFO networking_nsxv3.common.synchronization [req-03a84288-c6e8-4eb0-a438-97484d9c4d80 req-83d53316-99ca-4d70-94b1-47876409f20b tempest-InstanceActionsTestJSON-986456735 tempest-InstanceActionsTestJSON-986456735-project-member] Enqueued Resource ID: d45dc5c0-5228-4870-b34a-e7555a457f95 with Priority: HIGHEST for action security_group_members [ 1194.893429] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d45dc5c0-5228-4870-b34a-e7555a457f95 with Priority: HIGHEST for action security_group_members [ 1194.893640] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d45dc5c0-5228-4870-b34a-e7555a457f95 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.893765] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.893853] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.894136] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.894265] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.894363] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.894425] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.894578] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.894665] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.894758] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d45dc5c0-5228-4870-b34a-e7555a457f95',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.397548] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.397677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.397755] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.397983] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.398057] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.398278] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.398474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.398474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.398812] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.398812] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.398812] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d45dc5c0-5228-4870-b34a-e7555a457f95 already deleted. [ 1195.398929] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.460062] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-90 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.460279] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-90" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.460410] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-90" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.460755] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-90" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.461615] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.461815] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.461942] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.462195] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.462384] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.462613] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1195.462733] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1195.462845] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1195.462957] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1195.463088] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1195.463286] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1195.463377] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1195.482846] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1195.483085] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1195.483185] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1195.483368] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-90" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.483676] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-ca802e98-cbc6-48e4-8381-beef930ad40f taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.483849] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-ca802e98-cbc6-48e4-8381-beef930ad40f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.483975] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-ca802e98-cbc6-48e4-8381-beef930ad40f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.484349] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-ca802e98-cbc6-48e4-8381-beef930ad40f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.484708] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca802e98-cbc6-48e4-8381-beef930ad40f',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.987306] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.987707] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.987707] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.987792] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.988874] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.988874] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port ca802e98-cbc6-48e4-8381-beef930ad40f not found, creating... [ 1195.988874] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.988874] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.988874] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.988874] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.989207] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.989306] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.989468] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.989755] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.989972] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.990219] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.990455] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: ca802e98-cbc6-48e4-8381-beef930ad40f is going to be created. [ 1196.009118] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.009372] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.009537] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.009810] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.010103] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.010372] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-ca802e98-cbc6-48e4-8381-beef930ad40f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.642134] env[70013]: INFO networking_nsxv3.common.synchronization [None req-04c63e5c-ee69-452c-9be4-dc494cf6d821 None None] Enqueued Resource ID: 5372fe24-1cd2-427c-8040-76b2df51a03d with Priority: HIGHEST for action port [ 1196.643040] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5372fe24-1cd2-427c-8040-76b2df51a03d with Priority: HIGHEST for action port [ 1196.643040] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-5372fe24-1cd2-427c-8040-76b2df51a03d taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.643264] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5372fe24-1cd2-427c-8040-76b2df51a03d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.643264] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5372fe24-1cd2-427c-8040-76b2df51a03d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.643451] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5372fe24-1cd2-427c-8040-76b2df51a03d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.643533] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5372fe24-1cd2-427c-8040-76b2df51a03d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.756548] env[70013]: INFO networking_nsxv3.common.synchronization [req-03a84288-c6e8-4eb0-a438-97484d9c4d80 req-f91a2017-e8c4-44f4-a116-870c53eabbfa service nova] Enqueued Resource ID: d45dc5c0-5228-4870-b34a-e7555a457f95 with Priority: HIGHEST for action security_group_rules [ 1196.756548] env[70013]: INFO networking_nsxv3.common.synchronization [req-03a84288-c6e8-4eb0-a438-97484d9c4d80 req-f91a2017-e8c4-44f4-a116-870c53eabbfa service nova] Enqueued Resource ID: d45dc5c0-5228-4870-b34a-e7555a457f95 with Priority: HIGHEST for action security_group_members [ 1196.756548] env[70013]: INFO networking_nsxv3.common.synchronization [req-03a84288-c6e8-4eb0-a438-97484d9c4d80 req-f91a2017-e8c4-44f4-a116-870c53eabbfa service nova] Enqueued Resource ID: ca802e98-cbc6-48e4-8381-beef930ad40f with Priority: HIGHEST for action port [ 1196.756548] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d45dc5c0-5228-4870-b34a-e7555a457f95 with Priority: HIGHEST for action security_group_rules [ 1196.756765] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d45dc5c0-5228-4870-b34a-e7555a457f95 with Priority: HIGHEST for action security_group_members [ 1196.756765] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca802e98-cbc6-48e4-8381-beef930ad40f with Priority: HIGHEST for action port [ 1196.757624] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d45dc5c0-5228-4870-b34a-e7555a457f95 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.757759] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.757860] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.758171] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.758298] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d45dc5c0-5228-4870-b34a-e7555a457f95',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.759381] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d45dc5c0-5228-4870-b34a-e7555a457f95 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.759572] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.759677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.759889] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.760205] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.760285] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.760387] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.760578] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.760807] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.761037] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d45dc5c0-5228-4870-b34a-e7555a457f95',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.761688] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca802e98-cbc6-48e4-8381-beef930ad40f taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.761809] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca802e98-cbc6-48e4-8381-beef930ad40f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.761868] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca802e98-cbc6-48e4-8381-beef930ad40f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.763032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca802e98-cbc6-48e4-8381-beef930ad40f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.763032] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca802e98-cbc6-48e4-8381-beef930ad40f',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.145466] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5372fe24-1cd2-427c-8040-76b2df51a03d [ 1197.145832] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.145908] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.145951] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.146239] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.146974] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.146974] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5372fe24-1cd2-427c-8040-76b2df51a03d already deleted. [ 1197.147332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5372fe24-1cd2-427c-8040-76b2df51a03d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.265885] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d45dc5c0-5228-4870-b34a-e7555a457f95',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.265885] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d45dc5c0-5228-4870-b34a-e7555a457f95 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.265885] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.265885] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ca802e98-cbc6-48e4-8381-beef930ad40f with status ACTIVE [ 1197.265885] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.265885] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.266480] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.266480] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.266480] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.266581] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.266581] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.266664] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.266786] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.266869] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.267181] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.267346] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.267433] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.267604] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.267717] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.267827] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ca802e98-cbc6-48e4-8381-beef930ad40f is going to be updated. [ 1197.294677] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.295036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.295145] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.295336] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.295483] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.295656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca802e98-cbc6-48e4-8381-beef930ad40f" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.311357] env[70013]: INFO networking_nsxv3.common.synchronization [None req-b8630998-3be7-43bb-9493-e65b89907f11 tempest-AttachVolumeShelveTestJSON-1114130730 tempest-AttachVolumeShelveTestJSON-1114130730-project-member] Enqueued Resource ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 with Priority: HIGHEST for action security_group_rules [ 1197.311888] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 with Priority: HIGHEST for action security_group_rules [ 1197.312224] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.312327] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.312395] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.312648] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.312724] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7aa9a6a3-3934-4ea9-b361-0efe923f4669',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.456460] env[70013]: INFO networking_nsxv3.common.synchronization [None req-6aad6547-8466-4307-883c-498806d39597 tempest-AttachVolumeShelveTestJSON-1114130730 tempest-AttachVolumeShelveTestJSON-1114130730-project-member] Enqueued Resource ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 with Priority: HIGHEST for action security_group_rules [ 1197.456973] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 with Priority: HIGHEST for action security_group_rules [ 1197.457618] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.457724] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.775162] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d45dc5c0-5228-4870-b34a-e7555a457f95',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.832470] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.832605] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.832682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.832904] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.832995] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.833105] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 already deleted. [ 1197.833192] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.833340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.833495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.833583] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7aa9a6a3-3934-4ea9-b361-0efe923f4669',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.283256] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.283735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.283735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.283735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.283904] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.283904] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d45dc5c0-5228-4870-b34a-e7555a457f95 is going to be created. [ 1198.307280] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.307492] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.307492] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.307789] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.307994] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.316638] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d45dc5c0-5228-4870-b34a-e7555a457f95 in Status: UNINITIALIZED for 2s [ 1198.352922] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.353119] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.353162] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.353361] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.353456] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.353595] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 already deleted. [ 1198.353691] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.129062] env[70013]: INFO networking_nsxv3.common.synchronization [None req-3132cd31-3259-4201-b3b9-2e2fa0f3d9be None None] Enqueued Resource ID: 188e5018-99ac-4cb4-b371-1f1a540326ba with Priority: HIGHEST for action port [ 1199.129062] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 188e5018-99ac-4cb4-b371-1f1a540326ba with Priority: HIGHEST for action port [ 1199.129283] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-188e5018-99ac-4cb4-b371-1f1a540326ba taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.129410] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-188e5018-99ac-4cb4-b371-1f1a540326ba" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.129479] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-188e5018-99ac-4cb4-b371-1f1a540326ba" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.129725] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-188e5018-99ac-4cb4-b371-1f1a540326ba" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.130250] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('188e5018-99ac-4cb4-b371-1f1a540326ba',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.633440] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 188e5018-99ac-4cb4-b371-1f1a540326ba [ 1199.633440] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.633440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.633440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.633440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.633440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.633440] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:188e5018-99ac-4cb4-b371-1f1a540326ba already deleted. [ 1199.633440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-188e5018-99ac-4cb4-b371-1f1a540326ba" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.651449] env[70013]: INFO networking_nsxv3.common.synchronization [req-91e53cd4-ec25-4fba-9468-70b3c8678424 req-c4a487b2-7464-4430-8e98-83cdb17cceeb tempest-ServerActionsTestOtherA-108106573 tempest-ServerActionsTestOtherA-108106573-project-member] Enqueued Resource ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 with Priority: HIGHEST for action security_group_members [ 1199.651942] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 with Priority: HIGHEST for action security_group_members [ 1199.652268] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d0cfefe-0851-47aa-9a55-0d92164acbc1 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.652413] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.652478] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.652633] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.652776] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.654172] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.654298] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.654420] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.654507] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.654602] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d0cfefe-0851-47aa-9a55-0d92164acbc1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.000236] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.000447] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-353" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.000577] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-353" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.000852] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-353" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.001126] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.001288] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.001411] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.001625] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.001774] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.001982] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1200.002116] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1200.002222] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1200.002336] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1200.002447] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1200.002557] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1200.002691] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1200.019952] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1200.020139] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1200.020279] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1200.020465] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-353" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.020772] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-9912a098-b09d-4c69-819f-47a4d7da500b taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.020946] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-9912a098-b09d-4c69-819f-47a4d7da500b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.021087] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-9912a098-b09d-4c69-819f-47a4d7da500b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.021417] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-9912a098-b09d-4c69-819f-47a4d7da500b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.021562] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9912a098-b09d-4c69-819f-47a4d7da500b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.160552] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.160716] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.160820] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.161011] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.161110] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.161304] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.161408] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.161467] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.161615] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.161691] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.161781] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 is going to be deleted. [ 1200.189379] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.189534] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.189619] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.189831] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.189951] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.190074] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.326321] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d45dc5c0-5228-4870-b34a-e7555a457f95 in Status: SUCCESS [ 1200.326531] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.326691] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.326917] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.327122] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.327258] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.327338] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.327832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.327832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.327832] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.327832] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d45dc5c0-5228-4870-b34a-e7555a457f95',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.523595] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.523819] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.523959] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.524265] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.524426] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.524588] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 9912a098-b09d-4c69-819f-47a4d7da500b not found, creating... [ 1200.524852] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.525020] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.525146] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.525374] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.525517] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.525808] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.525971] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.526107] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.526369] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.526512] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.526655] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 9912a098-b09d-4c69-819f-47a4d7da500b is going to be created. [ 1200.547146] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.547350] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.547482] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.547712] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.547933] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.548159] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-9912a098-b09d-4c69-819f-47a4d7da500b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.830221] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d45dc5c0-5228-4870-b34a-e7555a457f95 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.830639] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.830639] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.830737] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.830907] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.831011] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.831142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.831234] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.831322] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.831411] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.831563] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d45dc5c0-5228-4870-b34a-e7555a457f95 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.831654] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.831729] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.831873] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.832024] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.832116] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.832178] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.832317] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.832391] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.832472] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.832563] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d45dc5c0-5228-4870-b34a-e7555a457f95',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.852158] env[70013]: INFO networking_nsxv3.common.synchronization [req-ee2fe36a-401c-42f6-957f-53ff13bc885a req-59a80f3d-de76-4c0e-95c2-f1fe3d5aa691 tempest-AttachInterfacesTestJSON-1580231832 tempest-AttachInterfacesTestJSON-1580231832-project-member] Enqueued Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_members [ 1200.852888] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_members [ 1200.853240] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.853361] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.853431] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.853668] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.853788] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.853882] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.853985] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.854146] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.854240] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.854339] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.315800] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.315993] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.317022] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.317022] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.317022] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.317022] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.317022] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.317257] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.317393] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.317599] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1201.317717] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1201.317828] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1201.317937] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1201.318061] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1201.318172] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1201.318307] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1201.335268] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d45dc5c0-5228-4870-b34a-e7555a457f95: rpc.has_security_group_logging(os_id): False [ 1201.337812] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1201.338050] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1201.338221] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1201.338435] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.338763] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-db65a4ad-ec52-4dd1-bb59-3c000719f018 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.338938] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-db65a4ad-ec52-4dd1-bb59-3c000719f018" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.339264] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-db65a4ad-ec52-4dd1-bb59-3c000719f018" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.339917] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-db65a4ad-ec52-4dd1-bb59-3c000719f018" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.339917] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db65a4ad-ec52-4dd1-bb59-3c000719f018',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.355269] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.355428] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.355482] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.355715] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.355899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.356047] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.356170] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.356392] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.356589] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.356680] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.356890] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.357028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.357083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.357253] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.357336] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.357529] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.357626] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.357690] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.357837] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.357914] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.358007] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d45dc5c0-5228-4870-b34a-e7555a457f95 is going to be created. [ 1201.359218] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.359329] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.359397] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.359550] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.359632] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.359871] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.360000] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.360000] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.360127] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.360163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.360249] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 is going to be updated. [ 1201.371258] env[70013]: INFO networking_nsxv3.common.synchronization [req-91e53cd4-ec25-4fba-9468-70b3c8678424 req-b69ee778-ca92-4f3c-82fd-a1062464011d service nova] Enqueued Resource ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 with Priority: HIGHEST for action security_group_rules [ 1201.371258] env[70013]: INFO networking_nsxv3.common.synchronization [req-91e53cd4-ec25-4fba-9468-70b3c8678424 req-b69ee778-ca92-4f3c-82fd-a1062464011d service nova] Enqueued Resource ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 with Priority: HIGHEST for action security_group_members [ 1201.371258] env[70013]: INFO networking_nsxv3.common.synchronization [req-91e53cd4-ec25-4fba-9468-70b3c8678424 req-b69ee778-ca92-4f3c-82fd-a1062464011d service nova] Enqueued Resource ID: 9912a098-b09d-4c69-819f-47a4d7da500b with Priority: HIGHEST for action port [ 1201.371258] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 with Priority: HIGHEST for action security_group_rules [ 1201.371475] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 with Priority: HIGHEST for action security_group_members [ 1201.371509] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9912a098-b09d-4c69-819f-47a4d7da500b with Priority: HIGHEST for action port [ 1201.371765] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d0cfefe-0851-47aa-9a55-0d92164acbc1 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.371874] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.371938] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.372130] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.372206] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d0cfefe-0851-47aa-9a55-0d92164acbc1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.374931] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d0cfefe-0851-47aa-9a55-0d92164acbc1 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.374931] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.374931] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.374931] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.374931] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.374931] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.374931] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.374931] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.374931] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.374931] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d0cfefe-0851-47aa-9a55-0d92164acbc1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.374931] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-9912a098-b09d-4c69-819f-47a4d7da500b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.376715] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9912a098-b09d-4c69-819f-47a4d7da500b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.376715] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9912a098-b09d-4c69-819f-47a4d7da500b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.376715] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9912a098-b09d-4c69-819f-47a4d7da500b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.376715] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9912a098-b09d-4c69-819f-47a4d7da500b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.391540] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.391703] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.391756] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.391960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.392387] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.400751] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: IN_PROGRESS for 2s [ 1201.422792] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.422956] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.422956] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.423190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.423425] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.435370] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d45dc5c0-5228-4870-b34a-e7555a457f95 in Status: IN_PROGRESS for 2s [ 1201.842620] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.842967] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.842967] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.843247] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.843407] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.843566] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port db65a4ad-ec52-4dd1-bb59-3c000719f018 not found, creating... [ 1201.843826] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.843988] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.844151] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.844422] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.844570] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.844860] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.845030] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.845153] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.845372] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.845505] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.845649] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: db65a4ad-ec52-4dd1-bb59-3c000719f018 is going to be created. [ 1201.866579] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.866766] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.866898] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.867183] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.867438] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.867665] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-db65a4ad-ec52-4dd1-bb59-3c000719f018" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.877093] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9912a098-b09d-4c69-819f-47a4d7da500b with status ACTIVE [ 1201.877344] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.877479] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.877591] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.877762] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.877844] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.878019] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.878119] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.878174] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.878315] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.878390] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.878569] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.878662] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.878723] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.878860] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.878934] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.879030] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9912a098-b09d-4c69-819f-47a4d7da500b is going to be updated. [ 1201.879977] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d0cfefe-0851-47aa-9a55-0d92164acbc1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.880735] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d0cfefe-0851-47aa-9a55-0d92164acbc1 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.880836] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.903019] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.903166] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.903257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.903483] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.903649] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.903825] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9912a098-b09d-4c69-819f-47a4d7da500b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.381756] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d0cfefe-0851-47aa-9a55-0d92164acbc1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.534848] env[70013]: INFO networking_nsxv3.common.synchronization [req-ee2fe36a-401c-42f6-957f-53ff13bc885a req-050bbc83-dc3d-4dbd-b46f-b4f257ede282 service nova] Enqueued Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_rules [ 1202.535176] env[70013]: INFO networking_nsxv3.common.synchronization [req-ee2fe36a-401c-42f6-957f-53ff13bc885a req-050bbc83-dc3d-4dbd-b46f-b4f257ede282 service nova] Enqueued Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_members [ 1202.535266] env[70013]: INFO networking_nsxv3.common.synchronization [req-ee2fe36a-401c-42f6-957f-53ff13bc885a req-050bbc83-dc3d-4dbd-b46f-b4f257ede282 service nova] Enqueued Resource ID: db65a4ad-ec52-4dd1-bb59-3c000719f018 with Priority: HIGHEST for action port [ 1202.535824] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_rules [ 1202.536009] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_members [ 1202.541048] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db65a4ad-ec52-4dd1-bb59-3c000719f018 with Priority: HIGHEST for action port [ 1202.541048] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.541048] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.541048] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.541048] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.541048] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.541048] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.541048] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.541048] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-db65a4ad-ec52-4dd1-bb59-3c000719f018 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.541048] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db65a4ad-ec52-4dd1-bb59-3c000719f018" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.541048] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db65a4ad-ec52-4dd1-bb59-3c000719f018" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.541048] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db65a4ad-ec52-4dd1-bb59-3c000719f018" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.541048] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db65a4ad-ec52-4dd1-bb59-3c000719f018',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.884031] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.884404] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.884404] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.884483] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.884581] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.884683] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 is going to be created. [ 1202.907597] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.907747] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.907831] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.908083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.908258] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.916912] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 in Status: UNINITIALIZED for 2s [ 1203.043422] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db65a4ad-ec52-4dd1-bb59-3c000719f018 with status ACTIVE [ 1203.043740] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.043874] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.043934] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.044276] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.044400] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.044562] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.044684] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.044750] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.044914] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.045043] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.045204] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.045291] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.045352] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.045498] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.045573] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.045660] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db65a4ad-ec52-4dd1-bb59-3c000719f018 is going to be updated. [ 1203.047802] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.047802] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.067276] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.067276] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.067276] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.067276] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.067276] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.067276] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db65a4ad-ec52-4dd1-bb59-3c000719f018" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.410957] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: SUCCESS [ 1203.411205] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 deletion is rescheduled due to dependency. [ 1203.411301] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.411418] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.411771] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.412097] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.412097] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.412097] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.412356] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.412356] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.412497] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.449159] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d45dc5c0-5228-4870-b34a-e7555a457f95 in Status: SUCCESS [ 1203.449388] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.589026] env[70013]: INFO networking_nsxv3.common.synchronization [req-bf55471b-d562-41a2-9c77-54d11dd84209 req-348f9dd2-7f11-474a-a951-47a0aa6a56d3 tempest-AttachVolumeShelveTestJSON-1114130730 tempest-AttachVolumeShelveTestJSON-1114130730-project-member] Enqueued Resource ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 with Priority: HIGHEST for action security_group_members [ 1203.591134] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 with Priority: HIGHEST for action security_group_members [ 1203.591134] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aa9a6a3-3934-4ea9-b361-0efe923f4669 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.591134] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.591134] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.591134] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.591805] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.591924] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.592053] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.592193] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.592288] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.592387] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7aa9a6a3-3934-4ea9-b361-0efe923f4669',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.918921] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.966046] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-63 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.966325] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-63" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.966471] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-63" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.966805] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-63" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.967085] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.967253] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.967398] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.967639] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.967794] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.968723] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1203.968917] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1203.969064] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1203.969188] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1203.969314] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1203.969433] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1203.969574] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1203.991443] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1203.991761] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1203.991980] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1203.992276] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-63" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.992750] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-b3b2c85d-9fe6-403f-bc6d-d003d2a06aef taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.993026] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-b3b2c85d-9fe6-403f-bc6d-d003d2a06aef" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.993219] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-b3b2c85d-9fe6-403f-bc6d-d003d2a06aef" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.993667] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-b3b2c85d-9fe6-403f-bc6d-d003d2a06aef" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.993880] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3b2c85d-9fe6-403f-bc6d-d003d2a06aef',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.094944] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.095167] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.095215] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.095402] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.095497] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.095698] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.095799] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.095863] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.096049] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.096131] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.096268] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 already deleted. [ 1204.096367] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.420930] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.497348] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.498959] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.498959] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.498959] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.498959] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.498959] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port b3b2c85d-9fe6-403f-bc6d-d003d2a06aef not found, creating... [ 1204.498959] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.499333] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.499405] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.499640] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.499782] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.500092] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.500326] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.500377] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.500588] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.500719] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.500859] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: b3b2c85d-9fe6-403f-bc6d-d003d2a06aef is going to be created. [ 1204.520341] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.520609] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.520742] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.521045] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.521488] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.521557] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-b3b2c85d-9fe6-403f-bc6d-d003d2a06aef" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.926350] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 in Status: SUCCESS [ 1204.926676] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.927250] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.927381] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.927381] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.927603] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.927695] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.927907] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 is going to be updated. [ 1204.928974] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.929209] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.929430] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.929551] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.929618] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.929810] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.929895] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.930014] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.930128] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d0cfefe-0851-47aa-9a55-0d92164acbc1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.955217] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.955217] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.955423] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.956037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.956334] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.964309] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: IN_PROGRESS for 2s [ 1205.357754] env[70013]: INFO networking_nsxv3.common.synchronization [req-bf55471b-d562-41a2-9c77-54d11dd84209 req-66b03d29-e302-4fe9-9f31-c764b7ff1d50 service nova] Enqueued Resource ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 with Priority: HIGHEST for action security_group_rules [ 1205.357754] env[70013]: INFO networking_nsxv3.common.synchronization [req-bf55471b-d562-41a2-9c77-54d11dd84209 req-66b03d29-e302-4fe9-9f31-c764b7ff1d50 service nova] Enqueued Resource ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 with Priority: HIGHEST for action security_group_members [ 1205.359556] env[70013]: INFO networking_nsxv3.common.synchronization [req-bf55471b-d562-41a2-9c77-54d11dd84209 req-66b03d29-e302-4fe9-9f31-c764b7ff1d50 service nova] Enqueued Resource ID: b3b2c85d-9fe6-403f-bc6d-d003d2a06aef with Priority: HIGHEST for action port [ 1205.360573] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 with Priority: HIGHEST for action security_group_rules [ 1205.361170] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 with Priority: HIGHEST for action security_group_members [ 1205.361170] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3b2c85d-9fe6-403f-bc6d-d003d2a06aef with Priority: HIGHEST for action port [ 1205.361475] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.361633] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.361738] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.362382] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.362382] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7aa9a6a3-3934-4ea9-b361-0efe923f4669',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.363859] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aa9a6a3-3934-4ea9-b361-0efe923f4669 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.363859] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.363859] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.364095] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.364359] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.364535] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.364629] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.364900] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.365065] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.365229] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7aa9a6a3-3934-4ea9-b361-0efe923f4669',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.366507] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3b2c85d-9fe6-403f-bc6d-d003d2a06aef taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.366692] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3b2c85d-9fe6-403f-bc6d-d003d2a06aef" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.366800] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3b2c85d-9fe6-403f-bc6d-d003d2a06aef" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.367152] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3b2c85d-9fe6-403f-bc6d-d003d2a06aef" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.367252] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3b2c85d-9fe6-403f-bc6d-d003d2a06aef',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.433616] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d0cfefe-0851-47aa-9a55-0d92164acbc1 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.433823] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.433879] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.434152] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.434338] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.434467] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.434539] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.434722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.434835] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.435170] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.435170] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d0cfefe-0851-47aa-9a55-0d92164acbc1 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.435294] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.435348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.435508] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.435666] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.435764] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.435849] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.436016] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.436122] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.436240] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.436360] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d0cfefe-0851-47aa-9a55-0d92164acbc1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.869990] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7aa9a6a3-3934-4ea9-b361-0efe923f4669',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.871030] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aa9a6a3-3934-4ea9-b361-0efe923f4669 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.871030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.871303] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3b2c85d-9fe6-403f-bc6d-d003d2a06aef with status ACTIVE [ 1205.871747] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.871747] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.871747] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.871927] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.871994] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.872354] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.872354] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.872501] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.872791] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.872791] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.872950] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.873075] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.873153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.873344] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.873480] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.873609] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3b2c85d-9fe6-403f-bc6d-d003d2a06aef is going to be updated. [ 1205.893710] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.893901] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.893947] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.894203] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.894358] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.894502] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3b2c85d-9fe6-403f-bc6d-d003d2a06aef" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.939138] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d0cfefe-0851-47aa-9a55-0d92164acbc1: rpc.has_security_group_logging(os_id): False [ 1205.963019] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.963019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.963019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.963019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.963019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.963019] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.963019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.963019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.963019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.963019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.963019] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.963019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.963019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.963019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.963019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.963828] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.963995] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.964199] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.964501] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.964859] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.965030] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 is going to be created. [ 1206.035041] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.035233] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.035304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.035630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.035886] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.047685] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 in Status: IN_PROGRESS for 2s [ 1206.371746] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7aa9a6a3-3934-4ea9-b361-0efe923f4669',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.875341] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.875462] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.875525] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.875885] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.875984] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.876100] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 is going to be created. [ 1206.898760] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.899059] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.899059] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.899298] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.899503] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.907852] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 in Status: UNINITIALIZED for 2s [ 1206.972327] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: SUCCESS [ 1206.972327] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.972327] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.972327] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.972788] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.972788] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.972788] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.972955] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.972955] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.973069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.973166] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.478021] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.478021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.478021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.478021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.478021] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.478021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.478021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.478021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.478021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.478021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.478021] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.478021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.478021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.478021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.478021] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.478021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.478727] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.478727] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.478727] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.478727] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.478727] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.620138] env[70013]: INFO networking_nsxv3.common.synchronization [None req-2e2be9cf-1c2a-4041-9176-76b93d0a986d tempest-AttachInterfacesTestJSON-1580231832 tempest-AttachInterfacesTestJSON-1580231832-project-member] Enqueued Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_members [ 1207.620138] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_members [ 1207.620732] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.620970] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.621214] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.621559] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.621809] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.622022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.622182] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.622466] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.622649] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.622819] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.982713] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4f3ddc1-2b27-4b61-95d8-aac256599271: rpc.has_security_group_logging(os_id): False [ 1208.002021] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.002021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.002021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.002021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.002021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.002021] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.002021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.002021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.002021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.002021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.002021] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.002021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.002021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.002021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.002021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.002883] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.003124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.003283] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.003518] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.003709] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.003897] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 is going to be updated. [ 1208.059138] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 in Status: SUCCESS [ 1208.059138] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.066493] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.066493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.066493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.066493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.066493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.074988] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: IN_PROGRESS for 2s [ 1208.125678] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.627618] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.918056] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 in Status: SUCCESS [ 1208.918322] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.918557] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.919297] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.919545] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.919700] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.919778] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.919981] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.920083] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.920172] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.920268] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7aa9a6a3-3934-4ea9-b361-0efe923f4669',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.129597] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.130066] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.130066] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.130213] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.130325] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.130437] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 is going to be updated. [ 1209.159225] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.159424] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.159424] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.159634] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.159833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.168108] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: IN_PROGRESS for 2s [ 1209.422068] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7aa9a6a3-3934-4ea9-b361-0efe923f4669',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.723052] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.723052] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.723052] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.723052] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.723316] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.723485] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.723609] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.723831] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.723988] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.724225] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1209.724345] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1209.724460] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1209.724580] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1209.724738] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1209.724873] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1209.725061] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1209.743786] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1209.743994] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1209.744163] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1209.744417] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.744763] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-36da126c-3f5a-43c8-98eb-774da4ecb681 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.744968] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-36da126c-3f5a-43c8-98eb-774da4ecb681" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.745122] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-36da126c-3f5a-43c8-98eb-774da4ecb681" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.745436] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-36da126c-3f5a-43c8-98eb-774da4ecb681" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.745582] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36da126c-3f5a-43c8-98eb-774da4ecb681',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.925317] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7aa9a6a3-3934-4ea9-b361-0efe923f4669: rpc.has_security_group_logging(os_id): False [ 1209.941971] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.942138] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.942237] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.942496] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.942603] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.942882] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.943012] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.943086] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.943268] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.943363] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.943428] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 is going to be created. [ 1210.000376] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.000525] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.000590] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.001334] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.001334] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.011430] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 in Status: IN_PROGRESS for 2s [ 1210.086884] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: SUCCESS [ 1210.087139] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.247802] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.248170] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.248314] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.248702] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.248926] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.249164] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 36da126c-3f5a-43c8-98eb-774da4ecb681 not found, creating... [ 1210.249578] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.249775] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.249981] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.250317] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.250545] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.250997] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.251257] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.251439] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.251738] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.251940] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.252169] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 36da126c-3f5a-43c8-98eb-774da4ecb681 is going to be created. [ 1210.274209] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.274452] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.274589] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.274870] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.275119] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.275344] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-36da126c-3f5a-43c8-98eb-774da4ecb681" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.639167] env[70013]: INFO networking_nsxv3.common.synchronization [req-03ecc54f-cb3d-4f67-8988-e666e0d900be req-9e7caf8c-377f-4bc5-b6b4-096b260c8228 tempest-ServerRescueNegativeTestJSON-1808745105 tempest-ServerRescueNegativeTestJSON-1808745105-project-member] Enqueued Resource ID: 250f9011-1d0c-4c88-9907-8d448831417a with Priority: HIGHEST for action security_group_members [ 1210.639167] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250f9011-1d0c-4c88-9907-8d448831417a with Priority: HIGHEST for action security_group_members [ 1210.639167] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-250f9011-1d0c-4c88-9907-8d448831417a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.639704] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.639704] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.639704] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.639704] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.639860] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.639860] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.639927] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.640060] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.640119] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('250f9011-1d0c-4c88-9907-8d448831417a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.121285] env[70013]: INFO networking_nsxv3.common.synchronization [req-c3422626-10b2-4fac-8628-df6d6c60a453 req-22373f6e-3091-46f4-ba47-99349ad06ca2 service nova] Enqueued Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_rules [ 1211.121466] env[70013]: INFO networking_nsxv3.common.synchronization [req-c3422626-10b2-4fac-8628-df6d6c60a453 req-22373f6e-3091-46f4-ba47-99349ad06ca2 service nova] Enqueued Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_members [ 1211.121612] env[70013]: INFO networking_nsxv3.common.synchronization [req-c3422626-10b2-4fac-8628-df6d6c60a453 req-22373f6e-3091-46f4-ba47-99349ad06ca2 service nova] Enqueued Resource ID: 36da126c-3f5a-43c8-98eb-774da4ecb681 with Priority: HIGHEST for action port [ 1211.121842] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_rules [ 1211.121988] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_members [ 1211.122131] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36da126c-3f5a-43c8-98eb-774da4ecb681 with Priority: HIGHEST for action port [ 1211.122659] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.122785] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.122854] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.124447] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.124545] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.128029] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.128154] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.128384] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-36da126c-3f5a-43c8-98eb-774da4ecb681 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.128498] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36da126c-3f5a-43c8-98eb-774da4ecb681" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.128565] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36da126c-3f5a-43c8-98eb-774da4ecb681" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.128806] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36da126c-3f5a-43c8-98eb-774da4ecb681" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.128895] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36da126c-3f5a-43c8-98eb-774da4ecb681',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.142012] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.142131] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.142216] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.142389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.142479] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.142659] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.142755] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.142819] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.142966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.143058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.143142] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 250f9011-1d0c-4c88-9907-8d448831417a is going to be updated. [ 1211.170798] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.170968] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.171069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.171276] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.171409] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.178534] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: SUCCESS [ 1211.178721] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.178871] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.179064] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.179234] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.179337] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.179401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.179545] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.179624] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.179719] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.180953] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250f9011-1d0c-4c88-9907-8d448831417a in Status: IN_PROGRESS for 2s [ 1211.189364] env[70013]: INFO networking_nsxv3.common.synchronization [req-0affe6df-0f80-4999-bf26-ba62d6a0eb06 req-d2fe501c-d4d3-4902-a26a-60548554d68a tempest-ServerActionsTestOtherA-108106573 tempest-ServerActionsTestOtherA-108106573-project-member] Enqueued Resource ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 with Priority: HIGHEST for action security_group_members [ 1211.189801] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 with Priority: HIGHEST for action security_group_members [ 1211.190327] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d0cfefe-0851-47aa-9a55-0d92164acbc1 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.190554] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.190652] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.190765] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.190980] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.191041] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.191075] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.191208] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.191275] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.191365] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d0cfefe-0851-47aa-9a55-0d92164acbc1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.230496] env[70013]: INFO networking_nsxv3.common.synchronization [req-0affe6df-0f80-4999-bf26-ba62d6a0eb06 req-d2fe501c-d4d3-4902-a26a-60548554d68a tempest-ServerActionsTestOtherA-108106573 tempest-ServerActionsTestOtherA-108106573-project-member] Enqueued Resource ID: 9912a098-b09d-4c69-819f-47a4d7da500b with Priority: HIGHEST for action port [ 1211.230975] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9912a098-b09d-4c69-819f-47a4d7da500b with Priority: HIGHEST for action port [ 1211.231284] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-9912a098-b09d-4c69-819f-47a4d7da500b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.231405] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9912a098-b09d-4c69-819f-47a4d7da500b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.231466] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9912a098-b09d-4c69-819f-47a4d7da500b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.231906] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9912a098-b09d-4c69-819f-47a4d7da500b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.231993] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9912a098-b09d-4c69-819f-47a4d7da500b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.630890] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.631261] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.631306] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36da126c-3f5a-43c8-98eb-774da4ecb681 with status ACTIVE [ 1211.631966] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.631966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.631966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.631966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.632254] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.632254] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.632333] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.632416] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.632571] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.632673] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.632889] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.632985] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.633072] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.633227] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.633349] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.633443] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36da126c-3f5a-43c8-98eb-774da4ecb681 is going to be updated. [ 1211.654247] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.654495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.654495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.654656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.654965] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.654965] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36da126c-3f5a-43c8-98eb-774da4ecb681" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.682513] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.693112] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.693242] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.693314] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.693525] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.693617] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.693796] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.693891] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.693953] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.694107] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.694234] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.694353] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 is going to be updated. [ 1211.732738] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.733892] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.734050] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.734309] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.734473] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.735565] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9912a098-b09d-4c69-819f-47a4d7da500b with status ACTIVE [ 1211.735756] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.735866] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.735950] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.736140] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.736227] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.736494] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.736595] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.736666] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.736830] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.736927] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.737183] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.737288] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.737348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.737493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.737571] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.737656] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9912a098-b09d-4c69-819f-47a4d7da500b is going to be updated. [ 1211.746903] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 in Status: IN_PROGRESS for 2s [ 1211.758090] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.759258] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.759258] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.759258] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.759258] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.759258] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9912a098-b09d-4c69-819f-47a4d7da500b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.802805] env[70013]: INFO networking_nsxv3.common.synchronization [req-20731126-2c04-471d-977c-19f712b3d334 req-d5a20abc-710f-45b1-a0fe-665363a3acba tempest-InstanceActionsTestJSON-986456735 tempest-InstanceActionsTestJSON-986456735-project-member] Enqueued Resource ID: d45dc5c0-5228-4870-b34a-e7555a457f95 with Priority: HIGHEST for action security_group_members [ 1211.803892] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d45dc5c0-5228-4870-b34a-e7555a457f95 with Priority: HIGHEST for action security_group_members [ 1211.803892] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d45dc5c0-5228-4870-b34a-e7555a457f95 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.803892] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.803892] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.804330] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.804330] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.804423] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.804457] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.804657] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.804705] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.804821] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d45dc5c0-5228-4870-b34a-e7555a457f95',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.022724] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 in Status: SUCCESS [ 1212.023018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.185125] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.307877] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.308039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.308170] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.308418] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.308545] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.308781] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.308909] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.308994] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.309172] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.309253] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.309343] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d45dc5c0-5228-4870-b34a-e7555a457f95 is going to be updated. [ 1212.335674] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.336017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.336183] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.336519] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.336805] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.344964] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d45dc5c0-5228-4870-b34a-e7555a457f95 in Status: IN_PROGRESS for 2s [ 1212.687528] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.687838] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.687838] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.688069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.688176] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.688317] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 is going to be updated. [ 1212.714026] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.714244] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.714244] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.714514] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.714674] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.722220] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: IN_PROGRESS for 2s [ 1213.193989] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 250f9011-1d0c-4c88-9907-8d448831417a in Status: SUCCESS [ 1213.193989] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 250f9011-1d0c-4c88-9907-8d448831417a deletion is rescheduled due to dependency. [ 1213.193989] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.758048] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 in Status: SUCCESS [ 1213.758367] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 deletion is rescheduled due to dependency. [ 1213.758487] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.354402] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d45dc5c0-5228-4870-b34a-e7555a457f95 in Status: SUCCESS [ 1214.354688] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d45dc5c0-5228-4870-b34a-e7555a457f95 deletion is rescheduled due to dependency. [ 1214.354744] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.735735] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: SUCCESS [ 1214.736097] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.736377] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.736691] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.737020] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.737189] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.737356] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.737574] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.737724] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.737878] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.738438] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.240761] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.241205] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.241205] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.241295] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.241389] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.241491] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.241556] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.241709] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.241797] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.241887] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.242047] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.242142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.242203] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.242349] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.242485] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.242576] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.242639] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.242783] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.242856] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.242940] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.243050] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.745509] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4f3ddc1-2b27-4b61-95d8-aac256599271: rpc.has_security_group_logging(os_id): False [ 1215.762631] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.762815] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.762871] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.763098] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.763190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.763389] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.763508] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.763581] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.763760] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.763862] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.764074] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.764187] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.764253] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.764413] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.764903] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.764903] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.764903] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.764903] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.765096] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.765096] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.765159] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 is going to be updated. [ 1215.826634] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.826634] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.826747] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.826890] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.827067] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.838851] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: IN_PROGRESS for 2s [ 1216.180163] env[70013]: INFO networking_nsxv3.common.synchronization [req-644ea31d-5ea1-40d4-a9b9-4728140f2d7f req-ea8cb758-520c-4a03-a3a5-32d73cc9b951 tempest-ServerDiskConfigTestJSON-536876121 tempest-ServerDiskConfigTestJSON-536876121-project-member] Enqueued Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1216.180651] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1216.180937] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.181072] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.181145] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.181402] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.181482] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.181582] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.181639] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.181803] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.181891] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.181979] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.690350] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.690714] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.690714] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.690808] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.690862] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.691069] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.691170] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.691231] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.691375] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.691450] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.691553] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f8a4673-59c5-493b-8250-617958bf996b is going to be updated. [ 1216.716617] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.716760] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.716835] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.717028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.717171] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.724990] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: IN_PROGRESS for 2s [ 1217.853247] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: SUCCESS [ 1217.853555] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.735463] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: SUCCESS [ 1218.735620] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f8a4673-59c5-493b-8250-617958bf996b deletion is rescheduled due to dependency. [ 1218.735719] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.182209] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1221.182519] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1223.008486] env[70013]: INFO networking_nsxv3.common.synchronization [req-18495c3d-ff2a-4801-9c68-fbc8e86c6336 req-32c922fc-4d26-4b2b-9398-a7f4d1545054 tempest-ServerRescueNegativeTestJSON-1808745105 tempest-ServerRescueNegativeTestJSON-1808745105-project-member] Enqueued Resource ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 with Priority: HIGHEST for action security_group_members [ 1223.009047] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 with Priority: HIGHEST for action security_group_members [ 1223.009368] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f3400e9-8b30-4b29-bde9-85cf198cabf0 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.009492] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.009558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.009757] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.009922] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.010078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.010124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.010238] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.010324] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.010438] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f3400e9-8b30-4b29-bde9-85cf198cabf0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.348959] env[70013]: INFO networking_nsxv3.common.synchronization [req-de0e2ffa-b02a-49bb-8f3d-4063b8008850 req-bc0d4d65-cacb-4a30-b724-7d152e8805db tempest-AttachInterfacesTestJSON-1580231832 tempest-AttachInterfacesTestJSON-1580231832-project-member] Enqueued Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_members [ 1223.349944] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_members [ 1223.349944] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.349944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.349944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.350191] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.350309] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.350403] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.350463] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.350953] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.350953] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.350953] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.513254] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f3400e9-8b30-4b29-bde9-85cf198cabf0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.828946] env[70013]: INFO networking_nsxv3.common.synchronization [None req-0e2691bc-5432-49c8-89ba-38c25b965df0 tempest-AttachInterfacesTestJSON-1580231832 tempest-AttachInterfacesTestJSON-1580231832-project-member] Enqueued Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_members [ 1223.828946] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_members [ 1223.828946] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.829294] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.853295] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.019524] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f3400e9-8b30-4b29-bde9-85cf198cabf0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.313459] env[70013]: INFO networking_nsxv3.common.synchronization [req-110c7dd6-57bf-4747-8fa6-71c4adfb20ed req-0f2a717b-4178-4760-909e-c55ab0cee9bc tempest-ServerDiskConfigTestJSON-536876121 tempest-ServerDiskConfigTestJSON-536876121-project-member] Enqueued Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1224.314050] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1224.314401] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.314563] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.314636] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.314840] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.314987] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.315151] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.315213] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.315402] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.315534] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.315650] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.356620] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.521482] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.521651] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.521769] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.521999] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.522094] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.522214] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 is going to be updated. [ 1224.560962] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.560962] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.560962] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.560962] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.560962] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.574532] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 in Status: IN_PROGRESS for 2s [ 1224.670019] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-194 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.670019] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-194" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.670019] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-194" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.670019] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-194" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.670019] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.670019] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.670383] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.670751] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.671095] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.671465] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1224.671739] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1224.671967] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1224.672207] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1224.672421] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1224.672638] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1224.672867] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1224.696689] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1224.696897] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1224.697066] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1224.697257] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-194" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.697583] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-954d7579-1660-4476-afe2-3759d551ef0c taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.697757] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-954d7579-1660-4476-afe2-3759d551ef0c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.697880] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-954d7579-1660-4476-afe2-3759d551ef0c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.698234] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-954d7579-1660-4476-afe2-3759d551ef0c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.698405] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('954d7579-1660-4476-afe2-3759d551ef0c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.818238] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.818443] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.818443] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.818620] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.818723] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.818918] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.819030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.819089] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.819239] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.819315] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.819403] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f8a4673-59c5-493b-8250-617958bf996b is going to be updated. [ 1224.845701] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.845884] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.845884] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.846102] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.846239] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.859120] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.859275] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.859409] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.859629] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.859747] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.859867] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 is going to be updated. [ 1224.866561] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: IN_PROGRESS for 2s [ 1224.887888] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.888060] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.888181] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.888319] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.888458] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.896638] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: IN_PROGRESS for 2s [ 1225.202450] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.202450] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.202450] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.202450] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.202966] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.202966] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 954d7579-1660-4476-afe2-3759d551ef0c not found, creating... [ 1225.203087] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.203300] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.203960] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.204261] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.204472] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.204823] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.205064] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.205232] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.205492] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.205679] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.205863] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 954d7579-1660-4476-afe2-3759d551ef0c is going to be created. [ 1225.226429] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.226761] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.226956] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.227325] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.227633] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.227915] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-954d7579-1660-4476-afe2-3759d551ef0c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.025022] env[70013]: INFO networking_nsxv3.common.synchronization [req-110c7dd6-57bf-4747-8fa6-71c4adfb20ed req-8d901fea-bc27-4764-b024-47b2ea870262 service nova] Enqueued Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_rules [ 1226.025249] env[70013]: INFO networking_nsxv3.common.synchronization [req-110c7dd6-57bf-4747-8fa6-71c4adfb20ed req-8d901fea-bc27-4764-b024-47b2ea870262 service nova] Enqueued Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1226.025399] env[70013]: INFO networking_nsxv3.common.synchronization [req-110c7dd6-57bf-4747-8fa6-71c4adfb20ed req-8d901fea-bc27-4764-b024-47b2ea870262 service nova] Enqueued Resource ID: 954d7579-1660-4476-afe2-3759d551ef0c with Priority: HIGHEST for action port [ 1226.025648] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_rules [ 1226.025777] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1226.025873] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 954d7579-1660-4476-afe2-3759d551ef0c with Priority: HIGHEST for action port [ 1226.026532] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.026661] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.026802] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.026935] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.030347] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.030347] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.030347] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.030347] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-954d7579-1660-4476-afe2-3759d551ef0c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.030347] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-954d7579-1660-4476-afe2-3759d551ef0c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.030722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-954d7579-1660-4476-afe2-3759d551ef0c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.030722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-954d7579-1660-4476-afe2-3759d551ef0c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.030793] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('954d7579-1660-4476-afe2-3759d551ef0c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.536024] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.536024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.536024] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 954d7579-1660-4476-afe2-3759d551ef0c with status ACTIVE [ 1226.536024] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.536024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.536024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.536024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.536024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.536024] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.536024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.536024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.536024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.536024] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.536024] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.536857] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.536857] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.536857] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.536857] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.536857] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 954d7579-1660-4476-afe2-3759d551ef0c is going to be updated. [ 1226.558862] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.558998] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.559072] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.559260] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.559394] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.559547] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-954d7579-1660-4476-afe2-3759d551ef0c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.581729] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 in Status: SUCCESS [ 1226.581925] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.634206] env[70013]: INFO networking_nsxv3.common.synchronization [req-24925911-8e27-4808-905a-c4e2d9d3084b req-944b206f-cda2-41ed-9af2-231e7cefbcb1 tempest-AttachInterfacesTestJSON-1580231832 tempest-AttachInterfacesTestJSON-1580231832-project-member] Enqueued Resource ID: d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de with Priority: HIGHEST for action security_group_members [ 1226.634825] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de with Priority: HIGHEST for action security_group_members [ 1226.635143] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.635269] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.635337] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.635540] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.635693] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.635791] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.635854] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.636009] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.636108] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.636199] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.876135] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: SUCCESS [ 1226.876346] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f8a4673-59c5-493b-8250-617958bf996b deletion is rescheduled due to dependency. [ 1226.876501] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.876661] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.876861] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.877168] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.877168] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.877289] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.877363] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.877440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.877552] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.903946] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: SUCCESS [ 1226.904133] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.904282] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.904544] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.904784] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.904910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.904981] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.905137] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.905247] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.905303] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.139991] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.139991] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.139991] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.139991] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.139991] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.140217] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.140333] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.140407] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.141126] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.141126] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.141126] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de is going to be updated. [ 1227.171722] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.171722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.171722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.171722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.171722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.181153] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de in Status: IN_PROGRESS for 2s [ 1227.380295] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.409561] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.410198] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.410198] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.410198] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.410198] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.410384] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.410384] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.410467] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.410648] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.410648] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.410819] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 is going to be updated. [ 1227.435428] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.435428] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.435428] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.435674] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.435781] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.445940] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: IN_PROGRESS for 2s [ 1227.882461] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.385124] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.385350] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.385350] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.385569] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.385735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.385822] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f8a4673-59c5-493b-8250-617958bf996b is going to be updated. [ 1228.413958] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.414167] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.414247] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.414403] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.414550] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.422382] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: IN_PROGRESS for 2s [ 1229.190795] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de in Status: SUCCESS [ 1229.191077] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de deletion is rescheduled due to dependency. [ 1229.191121] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.455531] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: SUCCESS [ 1229.455768] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 deletion is rescheduled due to dependency. [ 1229.455917] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.432710] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: SUCCESS [ 1230.433051] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.433231] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.433493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.433725] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.433864] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.433960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.434135] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.434191] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.434290] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.434387] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.852779] env[70013]: INFO networking_nsxv3.common.synchronization [req-7c4359b5-dd06-4585-b0d3-74697e886d68 req-1e78d345-cdc2-4098-8141-d13e71989c86 tempest-ServerRescueNegativeTestJSON-1808745105 tempest-ServerRescueNegativeTestJSON-1808745105-project-member] Enqueued Resource ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 with Priority: HIGHEST for action security_group_members [ 1230.853374] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 with Priority: HIGHEST for action security_group_members [ 1230.853691] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f3400e9-8b30-4b29-bde9-85cf198cabf0 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.853816] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.853881] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.859205] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.860077] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.860077] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.860077] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.860077] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.860077] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.860077] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f3400e9-8b30-4b29-bde9-85cf198cabf0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.938440] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.938440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.938440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.938440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.938440] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.938440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.938440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.938440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.938440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.938440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.938440] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.938440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.938440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.938440] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.938440] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.938994] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.938994] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.938994] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.938994] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.938994] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.938994] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.362192] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.362341] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.362410] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.362632] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.363184] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.363184] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.363184] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.363184] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.363411] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.363411] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.363411] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 is going to be updated. [ 1231.370362] env[70013]: INFO networking_nsxv3.common.synchronization [req-8e7a72f4-3594-4768-84ca-e76428f6a3cb req-5e683602-7bf9-4358-a2b8-d8f7215319a6 tempest-ServerActionsTestJSON-1661939768 tempest-ServerActionsTestJSON-1661939768-project-member] Enqueued Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGHEST for action security_group_members [ 1231.370898] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGHEST for action security_group_members [ 1231.371243] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.371333] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.371375] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.371550] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.371696] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.371787] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.371850] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.371994] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.372090] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.372179] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.392030] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.392182] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.392661] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.392661] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.392661] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.400823] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 in Status: IN_PROGRESS for 2s [ 1231.444366] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f8a4673-59c5-493b-8250-617958bf996b: rpc.has_security_group_logging(os_id): False [ 1231.462291] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.462445] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.462540] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.462705] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.462799] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.463031] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.463124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.463185] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.463338] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.463411] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.463584] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.463677] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.463734] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.463874] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.463945] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.464142] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.464225] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.464277] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.464406] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.464477] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.464569] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f8a4673-59c5-493b-8250-617958bf996b is going to be updated. [ 1231.526667] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.526842] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.527177] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.527177] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.527375] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.539935] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: IN_PROGRESS for 2s [ 1231.643454] env[70013]: INFO networking_nsxv3.common.synchronization [None req-5e8aa34c-9da9-4c75-a621-08ae9af73c01 tempest-AttachInterfacesTestJSON-1580231832 tempest-AttachInterfacesTestJSON-1580231832-project-member] Enqueued Resource ID: 1e621617-c129-4612-8c77-52b2900c7c59 with Priority: HIGHEST for action security_group_rules [ 1231.644072] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e621617-c129-4612-8c77-52b2900c7c59 with Priority: HIGHEST for action security_group_rules [ 1231.644387] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e621617-c129-4612-8c77-52b2900c7c59 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.644548] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.644627] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.644886] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.644967] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e621617-c129-4612-8c77-52b2900c7c59',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.729718] env[70013]: INFO networking_nsxv3.common.synchronization [None req-f7e0fe91-3312-45f8-b4da-8221933f163d tempest-AttachInterfacesTestJSON-1580231832 tempest-AttachInterfacesTestJSON-1580231832-project-member] Enqueued Resource ID: 1e621617-c129-4612-8c77-52b2900c7c59 with Priority: HIGHEST for action security_group_rules [ 1231.730380] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e621617-c129-4612-8c77-52b2900c7c59 with Priority: HIGHEST for action security_group_rules [ 1231.730633] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e621617-c129-4612-8c77-52b2900c7c59 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.730819] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.874027] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.874027] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.874257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.874391] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.874391] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.874591] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.874694] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.874758] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.874913] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.874992] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.875093] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 is going to be updated. [ 1231.905048] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.905193] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.905266] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.905466] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.905607] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.913636] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 in Status: IN_PROGRESS for 2s [ 1232.164777] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.164994] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.165123] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.165562] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.165604] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.165733] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e621617-c129-4612-8c77-52b2900c7c59 already deleted. [ 1232.165864] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.166115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.166359] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.166492] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e621617-c129-4612-8c77-52b2900c7c59',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.685804] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.685804] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.685804] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.685804] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.685804] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.686568] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e621617-c129-4612-8c77-52b2900c7c59 already deleted. [ 1232.686568] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.410425] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 in Status: SUCCESS [ 1233.410628] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 deletion is rescheduled due to dependency. [ 1233.410760] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.553871] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: SUCCESS [ 1233.554099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.923880] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 in Status: SUCCESS [ 1233.924190] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 deletion is rescheduled due to dependency. [ 1233.924190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.268794] env[70013]: INFO networking_nsxv3.common.synchronization [req-aa494882-1fe6-4cf2-81a1-fa83c5c7ceac req-2675d401-7f90-45d9-84f1-8e9541dd9c51 tempest-ServerActionsTestOtherA-108106573 tempest-ServerActionsTestOtherA-108106573-project-member] Enqueued Resource ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c with Priority: HIGHEST for action security_group_members [ 1235.269153] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c with Priority: HIGHEST for action security_group_members [ 1235.270021] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.270021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.270021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.270021] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.270438] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.270611] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.270747] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.270962] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.271130] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.271299] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca27a1b0-973f-4958-8f7f-a5c216cb9a8c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.546802] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.547098] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-353" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.547189] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-353" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.547482] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-353" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.547742] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.547916] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.548104] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.548314] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.548459] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.548680] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1235.548886] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1235.548954] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1235.549033] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1235.549153] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1235.549265] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1235.549401] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1235.569164] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1235.569164] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1235.569164] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1235.569368] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-353" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.569547] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-c963937e-c9c9-452b-a0d2-b2a4314681dd taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.569723] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-c963937e-c9c9-452b-a0d2-b2a4314681dd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.569862] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-c963937e-c9c9-452b-a0d2-b2a4314681dd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.570205] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-c963937e-c9c9-452b-a0d2-b2a4314681dd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.570364] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c963937e-c9c9-452b-a0d2-b2a4314681dd',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.774029] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca27a1b0-973f-4958-8f7f-a5c216cb9a8c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.992828] env[70013]: INFO networking_nsxv3.common.synchronization [req-880b699d-86f4-41d1-b850-092f6590290c req-fbecc021-3e9e-4cae-81a9-20b54845284d tempest-ServerDiskConfigTestJSON-536876121 tempest-ServerDiskConfigTestJSON-536876121-project-member] Enqueued Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1235.993424] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGHEST for action security_group_members [ 1235.993736] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.993860] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.993926] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.994148] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.994295] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.994389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.994450] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.994598] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.994686] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.995062] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.073028] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.073236] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.073384] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.073686] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.073882] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.076099] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port c963937e-c9c9-452b-a0d2-b2a4314681dd not found, creating... [ 1236.076099] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.076099] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.076099] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.076099] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.076099] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.076099] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.076099] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.076099] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.076543] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.076543] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.076543] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: c963937e-c9c9-452b-a0d2-b2a4314681dd is going to be created. [ 1236.096353] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.096533] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.096688] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.096931] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.097174] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.097388] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-c963937e-c9c9-452b-a0d2-b2a4314681dd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.276050] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca27a1b0-973f-4958-8f7f-a5c216cb9a8c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.497309] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.497470] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.497520] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.497767] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.497849] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.498063] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.498140] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.498259] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.498429] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.498523] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.498620] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f8a4673-59c5-493b-8250-617958bf996b is going to be updated. [ 1236.525446] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.525601] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.525659] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.525870] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.526017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.534633] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: IN_PROGRESS for 2s [ 1236.778449] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.781656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.781656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.781656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.781656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.781656] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c is going to be updated. [ 1236.788688] env[70013]: INFO networking_nsxv3.common.synchronization [req-aa494882-1fe6-4cf2-81a1-fa83c5c7ceac req-b5b91670-1dc7-4028-96c7-b5bd31f7be3c service nova] Enqueued Resource ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c with Priority: HIGHEST for action security_group_rules [ 1236.788893] env[70013]: INFO networking_nsxv3.common.synchronization [req-aa494882-1fe6-4cf2-81a1-fa83c5c7ceac req-b5b91670-1dc7-4028-96c7-b5bd31f7be3c service nova] Enqueued Resource ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c with Priority: HIGHEST for action security_group_members [ 1236.789080] env[70013]: INFO networking_nsxv3.common.synchronization [req-aa494882-1fe6-4cf2-81a1-fa83c5c7ceac req-b5b91670-1dc7-4028-96c7-b5bd31f7be3c service nova] Enqueued Resource ID: c963937e-c9c9-452b-a0d2-b2a4314681dd with Priority: HIGHEST for action port [ 1236.790223] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c with Priority: HIGHEST for action security_group_rules [ 1236.790334] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c with Priority: HIGHEST for action security_group_members [ 1236.790435] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c963937e-c9c9-452b-a0d2-b2a4314681dd with Priority: HIGHEST for action port [ 1236.790706] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.790841] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.790914] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.791320] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.791412] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca27a1b0-973f-4958-8f7f-a5c216cb9a8c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.792365] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.792464] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.792688] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-c963937e-c9c9-452b-a0d2-b2a4314681dd taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.792794] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c963937e-c9c9-452b-a0d2-b2a4314681dd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.792873] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c963937e-c9c9-452b-a0d2-b2a4314681dd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.793069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c963937e-c9c9-452b-a0d2-b2a4314681dd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.793149] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c963937e-c9c9-452b-a0d2-b2a4314681dd',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.819342] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.819544] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.819544] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.819755] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.819898] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.828231] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c in Status: IN_PROGRESS for 2s [ 1237.299304] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.299304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.299304] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c963937e-c9c9-452b-a0d2-b2a4314681dd with status ACTIVE [ 1237.299304] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.299304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.299304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.299304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.299304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.299304] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.299304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.299304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.299304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.299304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.299304] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.299970] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.299970] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.299970] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.299970] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.299970] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c963937e-c9c9-452b-a0d2-b2a4314681dd is going to be updated. [ 1237.305332] env[70013]: INFO networking_nsxv3.common.synchronization [req-0914f50d-69f9-4324-a198-a07653d027c1 req-a65cca3f-aac0-451d-88cd-f129bb5b3938 tempest-AttachVolumeNegativeTest-680083968 tempest-AttachVolumeNegativeTest-680083968-project-member] Enqueued Resource ID: e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 with Priority: HIGHEST for action security_group_members [ 1237.305332] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 with Priority: HIGHEST for action security_group_members [ 1237.305332] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.305332] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.305773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.306144] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.306419] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.306688] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.307257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.307835] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.308096] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.308318] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e56a9d58-7904-4a6e-8dc7-f39e99c54ed0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.321951] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.321951] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.321951] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.321951] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.321951] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.321951] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c963937e-c9c9-452b-a0d2-b2a4314681dd" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.814479] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.814658] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.814749] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.816033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.816033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.816033] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.816033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.816033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.816033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.816033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.816033] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 is going to be updated. [ 1237.841476] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.841652] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.841754] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.842084] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.842216] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.850918] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 in Status: IN_PROGRESS for 2s [ 1238.546125] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f8a4673-59c5-493b-8250-617958bf996b in Status: SUCCESS [ 1238.546416] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f8a4673-59c5-493b-8250-617958bf996b deletion is rescheduled due to dependency. [ 1238.546639] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.843887] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c in Status: SUCCESS [ 1238.844174] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.844369] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.844628] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.844900] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.845033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.845101] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.845264] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.845347] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.845445] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca27a1b0-973f-4958-8f7f-a5c216cb9a8c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.283933] env[70013]: INFO networking_nsxv3.common.synchronization [req-ef389d5e-7116-4c23-8542-64022bb2877a req-317a53f5-7c73-4599-b686-254e58f424b9 tempest-AttachInterfacesTestJSON-1580231832 tempest-AttachInterfacesTestJSON-1580231832-project-member] Enqueued Resource ID: 1e621617-c129-4612-8c77-52b2900c7c59 with Priority: HIGHEST for action security_group_members [ 1239.284456] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e621617-c129-4612-8c77-52b2900c7c59 with Priority: HIGHEST for action security_group_members [ 1239.284780] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e621617-c129-4612-8c77-52b2900c7c59 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.285307] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.285307] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.285307] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.285456] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.285456] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.285549] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.285650] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.285731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.285824] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e621617-c129-4612-8c77-52b2900c7c59',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.348136] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca27a1b0-973f-4958-8f7f-a5c216cb9a8c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.613086] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.613086] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.613086] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.613086] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.613086] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.619802] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.619802] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.619802] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.619802] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.619802] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1239.619802] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1239.619802] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1239.619802] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1239.619802] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1239.619802] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1239.619802] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1239.638991] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1239.639197] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1239.639342] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1239.639789] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.640210] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-0889717d-3194-4204-a46b-57e94fc35d6c taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.640441] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-0889717d-3194-4204-a46b-57e94fc35d6c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.640602] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-0889717d-3194-4204-a46b-57e94fc35d6c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.640967] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-0889717d-3194-4204-a46b-57e94fc35d6c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.641169] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0889717d-3194-4204-a46b-57e94fc35d6c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.788333] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.788504] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.788545] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.788769] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.788867] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.789085] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.789184] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.789259] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.789416] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.789502] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.789578] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e621617-c129-4612-8c77-52b2900c7c59 already deleted. [ 1239.789660] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.849943] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca27a1b0-973f-4958-8f7f-a5c216cb9a8c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.860691] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 in Status: SUCCESS [ 1239.860840] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 deletion is rescheduled due to dependency. [ 1239.860840] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.143292] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.144872] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.144872] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.144872] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.145106] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.145327] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 0889717d-3194-4204-a46b-57e94fc35d6c not found, creating... [ 1240.145650] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.145840] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.145964] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.146240] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.146400] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.146775] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.147016] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.147087] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.147314] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.147458] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.147608] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 0889717d-3194-4204-a46b-57e94fc35d6c is going to be created. [ 1240.170041] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.170041] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.170041] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.170041] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.170041] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.170435] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-0889717d-3194-4204-a46b-57e94fc35d6c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.353038] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.353038] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.353274] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.353310] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.353409] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.353517] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c is going to be updated. [ 1240.423026] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.423229] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.423229] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.423439] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.423605] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.435431] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c in Status: IN_PROGRESS for 2s [ 1240.890026] env[70013]: INFO networking_nsxv3.common.synchronization [req-ef389d5e-7116-4c23-8542-64022bb2877a req-69bed36c-0225-4469-aa17-c5564b7a733c service nova] Enqueued Resource ID: 1e621617-c129-4612-8c77-52b2900c7c59 with Priority: HIGHEST for action security_group_rules [ 1240.890307] env[70013]: INFO networking_nsxv3.common.synchronization [req-ef389d5e-7116-4c23-8542-64022bb2877a req-69bed36c-0225-4469-aa17-c5564b7a733c service nova] Enqueued Resource ID: 1e621617-c129-4612-8c77-52b2900c7c59 with Priority: HIGHEST for action security_group_members [ 1240.890523] env[70013]: INFO networking_nsxv3.common.synchronization [req-ef389d5e-7116-4c23-8542-64022bb2877a req-69bed36c-0225-4469-aa17-c5564b7a733c service nova] Enqueued Resource ID: 0889717d-3194-4204-a46b-57e94fc35d6c with Priority: HIGHEST for action port [ 1240.890976] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e621617-c129-4612-8c77-52b2900c7c59 with Priority: HIGHEST for action security_group_rules [ 1240.891142] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e621617-c129-4612-8c77-52b2900c7c59 with Priority: HIGHEST for action security_group_members [ 1240.891248] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0889717d-3194-4204-a46b-57e94fc35d6c with Priority: HIGHEST for action port [ 1240.891533] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e621617-c129-4612-8c77-52b2900c7c59 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.891660] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.891729] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.891936] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.892029] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e621617-c129-4612-8c77-52b2900c7c59',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.892863] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e621617-c129-4612-8c77-52b2900c7c59 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.893814] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.893863] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.894121] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.894317] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.894438] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.894519] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.894729] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.894847] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.894956] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e621617-c129-4612-8c77-52b2900c7c59',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.895860] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-0889717d-3194-4204-a46b-57e94fc35d6c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.895977] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0889717d-3194-4204-a46b-57e94fc35d6c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.896069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0889717d-3194-4204-a46b-57e94fc35d6c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.896243] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0889717d-3194-4204-a46b-57e94fc35d6c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.896321] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0889717d-3194-4204-a46b-57e94fc35d6c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.398637] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e621617-c129-4612-8c77-52b2900c7c59 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.398802] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.399031] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0889717d-3194-4204-a46b-57e94fc35d6c with status ACTIVE [ 1241.399257] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.399339] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.399390] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.399671] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.399788] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.399978] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.400153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.400211] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.400356] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.400435] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.400626] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.400721] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.400766] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.400908] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.400985] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.401081] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0889717d-3194-4204-a46b-57e94fc35d6c is going to be updated. [ 1241.402222] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e621617-c129-4612-8c77-52b2900c7c59',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.423611] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.423745] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.423816] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.424048] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.424195] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.424358] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0889717d-3194-4204-a46b-57e94fc35d6c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.904381] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e621617-c129-4612-8c77-52b2900c7c59',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.406362] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.406545] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.406667] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.406900] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.407029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.407162] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e621617-c129-4612-8c77-52b2900c7c59 is going to be created. [ 1242.435654] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.435880] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.435880] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.436071] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.436278] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.448264] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c in Status: SUCCESS [ 1242.448464] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.449141] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e621617-c129-4612-8c77-52b2900c7c59 in Status: UNINITIALIZED for 2s [ 1242.449276] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.449504] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.449680] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.449792] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.449858] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.450014] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.450102] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.450187] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.450280] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca27a1b0-973f-4958-8f7f-a5c216cb9a8c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.952842] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca27a1b0-973f-4958-8f7f-a5c216cb9a8c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.178611] env[70013]: INFO networking_nsxv3.common.synchronization [req-24e5f61a-85e8-45e4-a145-f7bdb531f040 req-b1016377-56df-4a1b-81a1-85d895e35b5b tempest-ServerActionsTestJSON-1661939768 tempest-ServerActionsTestJSON-1661939768-project-member] Enqueued Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGHEST for action security_group_members [ 1243.179235] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGHEST for action security_group_members [ 1243.179656] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.179750] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.179805] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.180039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.180208] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.180311] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.180373] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.180528] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.180620] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.180711] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.457322] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca27a1b0-973f-4958-8f7f-a5c216cb9a8c: rpc.has_security_group_logging(os_id): False [ 1243.481020] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.481020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.481020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.481020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.498788] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.499714] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.499714] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.499714] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.499714] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.499714] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.499714] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c is going to be updated. [ 1243.555698] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.555861] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.555907] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.556151] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.556264] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.559432] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.559643] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-885" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.559773] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-885" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.560106] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-885" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.560328] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.560502] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.560647] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.560931] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.561128] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.561376] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1243.561532] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1243.561675] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1243.561810] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1243.561932] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1243.562064] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1243.562204] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1243.567880] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c in Status: IN_PROGRESS for 2s [ 1243.580333] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1243.580568] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1243.580643] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1243.580778] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-885" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.581085] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-f4583380-5208-4372-ab67-cc6b64a287d2 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.581246] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-f4583380-5208-4372-ab67-cc6b64a287d2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.581388] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-f4583380-5208-4372-ab67-cc6b64a287d2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.581674] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-f4583380-5208-4372-ab67-cc6b64a287d2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.581811] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4583380-5208-4372-ab67-cc6b64a287d2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.683612] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.683768] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.683847] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.684125] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.684221] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.684424] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.684525] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.684580] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.684734] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.684811] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.684899] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 is going to be updated. [ 1243.710413] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.710601] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.710649] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.711166] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.711166] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.718836] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 in Status: IN_PROGRESS for 2s [ 1244.085136] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.085136] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.085136] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.085136] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.085136] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.085136] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port f4583380-5208-4372-ab67-cc6b64a287d2 not found, creating... [ 1244.085652] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.085652] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.085757] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.085888] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.086057] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.086331] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.086491] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.086613] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.086874] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.087029] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.087177] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: f4583380-5208-4372-ab67-cc6b64a287d2 is going to be created. [ 1244.106183] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.106373] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.106501] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.106804] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.107057] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.107276] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-f4583380-5208-4372-ab67-cc6b64a287d2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.458747] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e621617-c129-4612-8c77-52b2900c7c59 in Status: SUCCESS [ 1244.459008] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.459200] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.459425] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.459619] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.459738] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.459804] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.459960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.460055] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.460142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.460234] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e621617-c129-4612-8c77-52b2900c7c59',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.910270] env[70013]: INFO networking_nsxv3.common.synchronization [req-24e5f61a-85e8-45e4-a145-f7bdb531f040 req-96da1fda-c41f-4864-b15c-5759633695ec service nova] Enqueued Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGHEST for action security_group_rules [ 1244.910437] env[70013]: INFO networking_nsxv3.common.synchronization [req-24e5f61a-85e8-45e4-a145-f7bdb531f040 req-96da1fda-c41f-4864-b15c-5759633695ec service nova] Enqueued Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGHEST for action security_group_members [ 1244.910582] env[70013]: INFO networking_nsxv3.common.synchronization [req-24e5f61a-85e8-45e4-a145-f7bdb531f040 req-96da1fda-c41f-4864-b15c-5759633695ec service nova] Enqueued Resource ID: f4583380-5208-4372-ab67-cc6b64a287d2 with Priority: HIGHEST for action port [ 1244.912579] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGHEST for action security_group_rules [ 1244.912718] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGHEST for action security_group_members [ 1244.912789] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4583380-5208-4372-ab67-cc6b64a287d2 with Priority: HIGHEST for action port [ 1244.913887] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.913887] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.913887] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.914072] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.914111] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.915140] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.915229] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.915684] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4583380-5208-4372-ab67-cc6b64a287d2 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.915820] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4583380-5208-4372-ab67-cc6b64a287d2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.916206] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4583380-5208-4372-ab67-cc6b64a287d2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.916206] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4583380-5208-4372-ab67-cc6b64a287d2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.916206] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4583380-5208-4372-ab67-cc6b64a287d2',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.962795] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e621617-c129-4612-8c77-52b2900c7c59',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.418396] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f4583380-5208-4372-ab67-cc6b64a287d2 with status ACTIVE [ 1245.418671] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.418779] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.418843] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.419087] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.419181] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.419362] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.419463] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.419525] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.419682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.419762] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.420270] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.420270] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.420270] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.420270] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.420455] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.420455] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f4583380-5208-4372-ab67-cc6b64a287d2 is going to be updated. [ 1245.421554] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.421659] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.440699] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.440810] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.440863] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.441038] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.441169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.441316] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4583380-5208-4372-ab67-cc6b64a287d2" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.465705] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e621617-c129-4612-8c77-52b2900c7c59: rpc.has_security_group_logging(os_id): False [ 1245.482139] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.482257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.482328] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.482514] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.482599] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.482834] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.482934] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.482998] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.483170] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.483255] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.483344] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e621617-c129-4612-8c77-52b2900c7c59 is going to be created. [ 1245.538015] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.538210] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.538265] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.538499] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.538686] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.548732] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e621617-c129-4612-8c77-52b2900c7c59 in Status: IN_PROGRESS for 2s [ 1245.583756] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c in Status: SUCCESS [ 1245.583756] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.729648] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 in Status: SUCCESS [ 1245.729839] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 deletion is rescheduled due to dependency. [ 1245.729957] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.730133] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.730353] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.730542] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.730657] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.730722] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.730878] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.730961] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.731095] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.233943] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.738472] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.241452] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.241452] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.241452] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.241665] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.241665] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.241803] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 is going to be updated. [ 1247.267219] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.267378] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.267420] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.267635] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.267815] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.276973] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 in Status: IN_PROGRESS for 2s [ 1247.560332] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e621617-c129-4612-8c77-52b2900c7c59 in Status: SUCCESS [ 1247.560579] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.285917] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 in Status: SUCCESS [ 1249.286157] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.286317] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.286534] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.286760] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.286894] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.286963] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.287143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.287225] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.287313] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.287405] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.790141] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.913875] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1249.914045] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1250.293124] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6: rpc.has_security_group_logging(os_id): False [ 1250.311493] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.311493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.311493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.311713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.311811] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.312071] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.312172] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.312327] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.312402] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.312489] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.312697] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 is going to be updated. [ 1250.367497] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.367640] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.367701] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.367937] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.368100] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.380894] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 in Status: IN_PROGRESS for 2s [ 1252.394195] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 in Status: SUCCESS [ 1252.394522] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.915320] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1254.915556] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1255.847137] env[70013]: INFO networking_nsxv3.common.synchronization [req-d8b17d75-4743-448d-b7d3-b7af85d484a8 req-7d9276c2-8ab2-451c-923b-55827ea478dd tempest-AttachInterfacesTestJSON-1580231832 tempest-AttachInterfacesTestJSON-1580231832-project-member] Enqueued Resource ID: 1e621617-c129-4612-8c77-52b2900c7c59 with Priority: HIGHEST for action security_group_members [ 1255.849598] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e621617-c129-4612-8c77-52b2900c7c59 with Priority: HIGHEST for action security_group_members [ 1255.850108] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e621617-c129-4612-8c77-52b2900c7c59 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.850230] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.850296] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.850493] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.850636] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.850730] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.850789] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.850933] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.851023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.851114] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e621617-c129-4612-8c77-52b2900c7c59',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.146855] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.147237] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.147237] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.147478] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.147741] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.147940] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.148081] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.148310] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.148467] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.148699] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1256.148820] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1256.148927] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1256.149053] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1256.149159] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1256.149267] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1256.149403] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1256.170342] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1256.170563] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1256.170719] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1256.170896] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.171227] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-8b1a9cab-123c-45b9-9703-a6e46606f140 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.171404] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-8b1a9cab-123c-45b9-9703-a6e46606f140" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.171547] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-8b1a9cab-123c-45b9-9703-a6e46606f140" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.171857] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-8b1a9cab-123c-45b9-9703-a6e46606f140" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.172009] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b1a9cab-123c-45b9-9703-a6e46606f140',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.353147] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e621617-c129-4612-8c77-52b2900c7c59',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.675026] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.675260] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.675319] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.675738] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.675962] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.676167] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 8b1a9cab-123c-45b9-9703-a6e46606f140 not found, creating... [ 1256.676477] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.676669] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.676898] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.677152] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.677339] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.677658] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.677874] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.678037] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.678258] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.678404] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.678549] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 8b1a9cab-123c-45b9-9703-a6e46606f140 is going to be created. [ 1256.697072] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.697280] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.697385] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.697623] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.697862] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.698121] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-8b1a9cab-123c-45b9-9703-a6e46606f140" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.855614] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e621617-c129-4612-8c77-52b2900c7c59',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.358334] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.358662] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.358662] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.358937] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.359056] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.359297] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e621617-c129-4612-8c77-52b2900c7c59 is going to be updated. [ 1257.389381] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.389558] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.389645] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.389902] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.390032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.398159] env[70013]: INFO networking_nsxv3.common.synchronization [req-d8b17d75-4743-448d-b7d3-b7af85d484a8 req-6f26a442-69c5-468b-a4ed-c3c54284b7fa service nova] Enqueued Resource ID: 1e621617-c129-4612-8c77-52b2900c7c59 with Priority: HIGHEST for action security_group_rules [ 1257.398354] env[70013]: INFO networking_nsxv3.common.synchronization [req-d8b17d75-4743-448d-b7d3-b7af85d484a8 req-6f26a442-69c5-468b-a4ed-c3c54284b7fa service nova] Enqueued Resource ID: 1e621617-c129-4612-8c77-52b2900c7c59 with Priority: HIGHEST for action security_group_members [ 1257.398498] env[70013]: INFO networking_nsxv3.common.synchronization [req-d8b17d75-4743-448d-b7d3-b7af85d484a8 req-6f26a442-69c5-468b-a4ed-c3c54284b7fa service nova] Enqueued Resource ID: 8b1a9cab-123c-45b9-9703-a6e46606f140 with Priority: HIGHEST for action port [ 1257.399312] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e621617-c129-4612-8c77-52b2900c7c59 in Status: IN_PROGRESS for 2s [ 1257.399458] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e621617-c129-4612-8c77-52b2900c7c59 with Priority: HIGHEST for action security_group_rules [ 1257.399585] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e621617-c129-4612-8c77-52b2900c7c59 with Priority: HIGHEST for action security_group_members [ 1257.399680] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b1a9cab-123c-45b9-9703-a6e46606f140 with Priority: HIGHEST for action port [ 1257.401330] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e621617-c129-4612-8c77-52b2900c7c59 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.401424] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.401424] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.401617] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.401712] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e621617-c129-4612-8c77-52b2900c7c59',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.403699] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e621617-c129-4612-8c77-52b2900c7c59 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.403699] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.403898] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b1a9cab-123c-45b9-9703-a6e46606f140 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.403956] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b1a9cab-123c-45b9-9703-a6e46606f140" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.404037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b1a9cab-123c-45b9-9703-a6e46606f140" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.404588] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b1a9cab-123c-45b9-9703-a6e46606f140" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.404588] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b1a9cab-123c-45b9-9703-a6e46606f140',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.907041] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e621617-c129-4612-8c77-52b2900c7c59 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.907041] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.907234] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b1a9cab-123c-45b9-9703-a6e46606f140 with status ACTIVE [ 1257.907234] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.907337] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.907426] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.907708] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.907908] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.908185] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.908331] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.908405] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.908618] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.908734] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.908958] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.909113] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.909349] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.909567] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.909679] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.909819] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b1a9cab-123c-45b9-9703-a6e46606f140 is going to be updated. [ 1257.929111] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.929390] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.929532] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.929721] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.929859] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.930063] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b1a9cab-123c-45b9-9703-a6e46606f140" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.409491] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e621617-c129-4612-8c77-52b2900c7c59 in Status: SUCCESS [ 1259.409831] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.409892] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.410117] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.410310] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.410425] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.410490] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.410641] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.410725] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.410822] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e621617-c129-4612-8c77-52b2900c7c59',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.912850] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e621617-c129-4612-8c77-52b2900c7c59',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.414650] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e621617-c129-4612-8c77-52b2900c7c59',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.917176] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.917341] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.917610] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.917870] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.917999] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.918123] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e621617-c129-4612-8c77-52b2900c7c59 is going to be updated. [ 1260.944903] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.945094] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.945157] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.945397] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.945559] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.953958] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e621617-c129-4612-8c77-52b2900c7c59 in Status: IN_PROGRESS for 2s [ 1261.824831] env[70013]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1261.825336] env[70013]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] NSXv3 Agent Agent loop - iteration:3 started [ 1262.400396] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1262.400666] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1262.964925] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e621617-c129-4612-8c77-52b2900c7c59 in Status: SUCCESS [ 1262.965348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.965348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.965552] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.965754] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.965869] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.965932] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.966106] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.966190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.966275] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.966371] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e621617-c129-4612-8c77-52b2900c7c59',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.469171] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e621617-c129-4612-8c77-52b2900c7c59',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.971835] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e621617-c129-4612-8c77-52b2900c7c59: rpc.has_security_group_logging(os_id): False [ 1263.991058] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.991278] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.991390] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.991619] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.991735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.992024] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.992134] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.992190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.992347] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.992423] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.992516] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e621617-c129-4612-8c77-52b2900c7c59 is going to be updated. [ 1264.055728] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.055979] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.055979] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.056159] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.056310] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.069749] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e621617-c129-4612-8c77-52b2900c7c59 in Status: IN_PROGRESS for 2s [ 1266.086249] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e621617-c129-4612-8c77-52b2900c7c59 in Status: SUCCESS [ 1266.086249] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.267209] env[70013]: INFO networking_nsxv3.common.synchronization [None req-7f77f67e-5f0f-462c-b3c1-c0af77d84a25 tempest-AttachInterfacesTestJSON-1580231832 tempest-AttachInterfacesTestJSON-1580231832-project-member] Enqueued Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_members [ 1266.267209] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_members [ 1266.267540] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.267806] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.267999] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.268359] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.268714] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.268997] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.269185] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.269496] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.269703] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.269906] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.772394] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.772642] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.772642] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.772851] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.772944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.773230] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.773345] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.773406] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.773564] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.773644] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.773735] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 is going to be updated. [ 1266.797305] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.797536] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.797536] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.797713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.797854] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.805826] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: IN_PROGRESS for 2s [ 1268.817348] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: SUCCESS [ 1268.817348] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 deletion is rescheduled due to dependency. [ 1268.817348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.268171] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1271.268519] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1276.269598] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1276.270033] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1281.270696] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1281.270989] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1286.272455] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1286.272455] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1286.670667] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-63 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.670911] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-63" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.671055] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-63" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.671346] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-63" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.671607] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.671767] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.671888] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.672125] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.672290] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.672523] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1286.672646] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1286.672759] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1286.672873] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1286.672986] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1286.673111] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1286.673250] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1286.692269] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1286.692422] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1286.692561] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1286.692724] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-63" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.692982] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-b3b2c85d-9fe6-403f-bc6d-d003d2a06aef taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.693158] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-b3b2c85d-9fe6-403f-bc6d-d003d2a06aef" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.693281] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-b3b2c85d-9fe6-403f-bc6d-d003d2a06aef" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.693505] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-b3b2c85d-9fe6-403f-bc6d-d003d2a06aef" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.693645] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3b2c85d-9fe6-403f-bc6d-d003d2a06aef',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.195680] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.195936] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.196058] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.196368] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.196528] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.196818] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.196984] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.197120] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.197352] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.197490] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.197779] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.197938] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.198073] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.198302] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.198479] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.198630] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: b3b2c85d-9fe6-403f-bc6d-d003d2a06aef is going to be updated. [ 1287.218558] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.218727] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.218851] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.219104] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.219299] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.219520] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-b3b2c85d-9fe6-403f-bc6d-d003d2a06aef" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.882324] env[70013]: INFO networking_nsxv3.common.synchronization [req-e0125010-8d9d-410f-beca-0207855bafe0 req-50746410-c3cc-47bb-81c2-fe8e85f8ddf1 service nova] Enqueued Resource ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 with Priority: HIGHEST for action security_group_rules [ 1287.882585] env[70013]: INFO networking_nsxv3.common.synchronization [req-e0125010-8d9d-410f-beca-0207855bafe0 req-50746410-c3cc-47bb-81c2-fe8e85f8ddf1 service nova] Enqueued Resource ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 with Priority: HIGHEST for action security_group_members [ 1287.882681] env[70013]: INFO networking_nsxv3.common.synchronization [req-e0125010-8d9d-410f-beca-0207855bafe0 req-50746410-c3cc-47bb-81c2-fe8e85f8ddf1 service nova] Enqueued Resource ID: b3b2c85d-9fe6-403f-bc6d-d003d2a06aef with Priority: HIGHEST for action port [ 1287.882888] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 with Priority: HIGHEST for action security_group_rules [ 1287.883027] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 with Priority: HIGHEST for action security_group_members [ 1287.883126] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3b2c85d-9fe6-403f-bc6d-d003d2a06aef with Priority: HIGHEST for action port [ 1287.883674] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.883804] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.883873] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.884114] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.884195] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7aa9a6a3-3934-4ea9-b361-0efe923f4669',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.885966] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aa9a6a3-3934-4ea9-b361-0efe923f4669 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.886099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.886167] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.886337] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.886494] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.886575] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.886662] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.886773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.886861] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.886962] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7aa9a6a3-3934-4ea9-b361-0efe923f4669',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.887705] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3b2c85d-9fe6-403f-bc6d-d003d2a06aef taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.887861] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3b2c85d-9fe6-403f-bc6d-d003d2a06aef" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.887914] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3b2c85d-9fe6-403f-bc6d-d003d2a06aef" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.888904] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3b2c85d-9fe6-403f-bc6d-d003d2a06aef" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.888904] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3b2c85d-9fe6-403f-bc6d-d003d2a06aef',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.386537] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aa9a6a3-3934-4ea9-b361-0efe923f4669 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.386685] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.390087] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3b2c85d-9fe6-403f-bc6d-d003d2a06aef with status ACTIVE [ 1288.390280] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.390400] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.390476] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.390675] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.390767] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.390939] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.391054] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.391110] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.391265] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.391344] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.391525] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.391627] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.391688] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.391830] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.391903] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.391987] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3b2c85d-9fe6-403f-bc6d-d003d2a06aef is going to be updated. [ 1288.393061] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7aa9a6a3-3934-4ea9-b361-0efe923f4669',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.412619] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.412751] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.412813] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.413507] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.413507] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.413507] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3b2c85d-9fe6-403f-bc6d-d003d2a06aef" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.894802] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7aa9a6a3-3934-4ea9-b361-0efe923f4669',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.397803] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.397995] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.398089] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.398396] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.398496] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.398601] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 is going to be updated. [ 1289.424939] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.425088] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.425163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.425372] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.425517] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.433235] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 in Status: IN_PROGRESS for 2s [ 1291.413286] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.413602] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.413642] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.413956] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.414257] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.414448] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.414573] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.414819] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.414992] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.415272] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1291.415410] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1291.415535] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1291.415651] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1291.415785] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1291.415896] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1291.416059] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1291.442060] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1291.442246] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1291.442408] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1291.442585] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.442913] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.443123] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.443258] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.443598] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.443772] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.445876] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 in Status: SUCCESS [ 1291.446099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.446252] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.446481] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.446680] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.446798] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.446864] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.447029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.447134] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.447245] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.447323] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7aa9a6a3-3934-4ea9-b361-0efe923f4669',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.946361] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.946564] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.946676] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.946966] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.947145] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.947338] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae not found, creating... [ 1291.947673] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.947860] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.947989] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.948261] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.948415] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.948718] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.948867] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.948992] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.949223] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.949380] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.949528] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae is going to be created. [ 1291.951692] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7aa9a6a3-3934-4ea9-b361-0efe923f4669',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.974829] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.975131] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.975329] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.975668] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.975945] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.976228] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.454251] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7aa9a6a3-3934-4ea9-b361-0efe923f4669: rpc.has_security_group_logging(os_id): False [ 1292.471326] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.471539] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.471539] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.471797] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.471907] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.472077] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.472226] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.472226] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.472389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.472481] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.472559] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 is going to be updated. [ 1292.529806] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.530473] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.530590] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.530801] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.530931] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.544999] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 in Status: IN_PROGRESS for 2s [ 1292.639338] env[70013]: INFO networking_nsxv3.common.synchronization [req-c43208bd-b2d8-4da5-be22-ed9f623e45d0 req-5a5c16fb-395b-46af-a8d6-ba9dcf8fedc7 service nova] Enqueued Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_rules [ 1292.639566] env[70013]: INFO networking_nsxv3.common.synchronization [req-c43208bd-b2d8-4da5-be22-ed9f623e45d0 req-5a5c16fb-395b-46af-a8d6-ba9dcf8fedc7 service nova] Enqueued Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_members [ 1292.639663] env[70013]: INFO networking_nsxv3.common.synchronization [req-c43208bd-b2d8-4da5-be22-ed9f623e45d0 req-5a5c16fb-395b-46af-a8d6-ba9dcf8fedc7 service nova] Enqueued Resource ID: b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae with Priority: HIGHEST for action port [ 1292.639893] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_rules [ 1292.640030] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_members [ 1292.640132] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae with Priority: HIGHEST for action port [ 1292.640659] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.640780] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.640853] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.641055] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.641136] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.641938] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.642067] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.642136] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.642300] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.642445] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.642539] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.642599] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.642743] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.642829] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.642959] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.643684] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.643792] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.643851] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.644009] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.644084] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.146388] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.146531] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.147497] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.148531] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae with status ACTIVE [ 1293.148837] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.148987] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.149074] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.149279] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.149373] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.149563] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.149666] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.149730] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.149943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.150089] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.150285] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.150490] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.150490] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.150602] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.150650] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.150936] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae is going to be updated. [ 1293.173231] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.173445] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.173445] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.173884] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.173884] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.174129] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.652750] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.155455] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.155664] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.155745] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.155911] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.156011] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.156122] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 is going to be updated. [ 1294.190635] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.190781] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.190864] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.191124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.191293] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.201966] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: IN_PROGRESS for 2s [ 1294.561677] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 in Status: SUCCESS [ 1294.562109] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.212246] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: SUCCESS [ 1296.212594] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.212668] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.212878] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.213099] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.213217] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.213280] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.213433] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.213514] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.213596] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.213686] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.716050] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.716266] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.716381] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.716740] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.717014] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.717217] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.717406] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.717693] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.717840] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.717978] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.718195] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.718331] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.718456] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.718698] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.718948] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.719086] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.719186] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.719412] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.719519] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.719618] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.719728] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.221868] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4f3ddc1-2b27-4b61-95d8-aac256599271: rpc.has_security_group_logging(os_id): False [ 1297.241578] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.241578] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.241578] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.241578] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.241578] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.241961] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.242169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.242416] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.242911] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.242911] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.243107] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.243316] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.243366] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.243562] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.243750] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.244068] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.244409] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.244409] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.244521] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.244628] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.244830] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 is going to be updated. [ 1297.305036] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.305036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.305036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.305036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.305481] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.321271] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: IN_PROGRESS for 2s [ 1297.641628] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1297.641628] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1299.336940] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: SUCCESS [ 1299.337372] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.643447] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1302.643447] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1304.581644] env[70013]: INFO networking_nsxv3.common.synchronization [req-0957d4e0-e68a-458b-b347-5e4843a8e9a6 req-f560482a-a2f3-4762-be84-72d814f84fd6 tempest-ServerActionsTestOtherA-108106573 tempest-ServerActionsTestOtherA-108106573-project-member] Enqueued Resource ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c with Priority: HIGHEST for action security_group_members [ 1304.582326] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c with Priority: HIGHEST for action security_group_members [ 1304.582613] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.582797] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.582949] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.583097] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.583287] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.583421] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.583497] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.583700] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.583823] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.583929] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca27a1b0-973f-4958-8f7f-a5c216cb9a8c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.086475] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca27a1b0-973f-4958-8f7f-a5c216cb9a8c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.531439] env[70013]: INFO networking_nsxv3.common.synchronization [req-78d23a08-5feb-4580-bdf2-17e521728f78 req-9e440aee-2634-4e37-b4fb-d1bd1e0f885c tempest-ServerActionsTestJSON-1661939768 tempest-ServerActionsTestJSON-1661939768-project-member] Enqueued Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGHEST for action security_group_members [ 1305.531856] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGHEST for action security_group_members [ 1305.532165] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.532282] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.532348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.532557] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.533936] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.533936] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.533936] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.533936] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.538018] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.538018] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.588772] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca27a1b0-973f-4958-8f7f-a5c216cb9a8c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.036583] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.036731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.036798] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.037026] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.037121] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.037341] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.037464] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.037526] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.037679] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.037751] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.037833] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 is going to be updated. [ 1306.064599] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.064740] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.064811] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.065112] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.065174] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.072246] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 in Status: IN_PROGRESS for 2s [ 1306.090988] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.090988] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.090988] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.091176] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.091176] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.091278] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c is going to be updated. [ 1306.114390] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.114522] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.114591] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.114784] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.114916] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.122029] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c in Status: IN_PROGRESS for 2s [ 1307.758674] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-418 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.758972] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.759017] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.759277] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.759530] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.759693] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.759815] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.760038] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.760192] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.760409] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1307.760528] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1307.760639] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1307.760753] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1307.760866] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1307.760975] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1307.761123] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1307.777408] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.777555] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.777656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.777849] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.777955] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.779860] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1307.780033] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1307.780179] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1307.780352] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-418" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.780635] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.780978] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.780978] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.781154] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.781286] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.081605] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 in Status: SUCCESS [ 1308.081605] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 deletion is rescheduled due to dependency. [ 1308.081772] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.131294] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c in Status: IN_PROGRESS for 4s [ 1308.283386] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.284600] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.284863] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.285048] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.285482] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.285705] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.286024] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.286208] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.286337] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.286630] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.286799] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.287125] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.287297] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.287437] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.287703] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.287850] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.287998] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae is going to be updated. [ 1308.312015] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.312292] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.312449] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.312725] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.312971] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.313160] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.790693] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.985370] env[70013]: INFO networking_nsxv3.common.synchronization [req-f2affe58-a2b3-494b-976f-f629b956740f req-fb99f96d-5b48-4e64-b652-013c75268c40 service nova] Enqueued Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_rules [ 1308.985561] env[70013]: INFO networking_nsxv3.common.synchronization [req-f2affe58-a2b3-494b-976f-f629b956740f req-fb99f96d-5b48-4e64-b652-013c75268c40 service nova] Enqueued Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_members [ 1308.985705] env[70013]: INFO networking_nsxv3.common.synchronization [req-f2affe58-a2b3-494b-976f-f629b956740f req-fb99f96d-5b48-4e64-b652-013c75268c40 service nova] Enqueued Resource ID: b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae with Priority: HIGHEST for action port [ 1308.986206] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_rules [ 1308.986343] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_members [ 1308.986443] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae with Priority: HIGHEST for action port [ 1308.986722] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.986837] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.986903] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.987232] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.987317] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.991037] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.991037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.991037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.991037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.991037] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.991037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.991037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.991037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.991037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.991037] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.991037] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.991037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.991037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.991037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.991037] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.293079] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1309.293230] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1309.495943] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.495943] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.495943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.495943] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae with status ACTIVE [ 1309.495943] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.495943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.495943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.495943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.495943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.495943] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.495943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.495943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.495943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.495943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.498980] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.498980] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.498980] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.498980] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.498980] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.499374] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae is going to be updated. [ 1309.518766] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.518907] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.519022] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.519243] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.519377] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.519532] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b72ae1ea-1ffa-4b9c-a6eb-103a9e5ed0ae" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.001477] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.077257] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.077399] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.077550] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.077757] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.090291] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1310.092788] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.093619] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1310.130231] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.130392] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.130471] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.130630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.145113] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.145893] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1310.145979] env[70013]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70013) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1310.146085] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1310.155147] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c in Status: SUCCESS [ 1310.155335] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.184668] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.184848] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.185294] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.185294] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.186786] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.186967] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1310.256842] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.257037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.257037] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.257250] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.257684] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.257991] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1310.327964] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.328142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.328209] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.328391] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.328822] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.329138] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:41. [ 1310.329236] env[70013]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'16c877e7-f731-49a5-b994-7d74c36c464b', '7aa9a6a3-3934-4ea9-b361-0efe923f4669', '9b51e70d-5edb-4332-99e9-eb53e6015365', '5d0cfefe-0851-47aa-9a55-0d92164acbc1', '250f9011-1d0c-4c88-9907-8d448831417a', '9378f72e-568d-4e53-8f92-4547bbc2beb3', '1f3400e9-8b30-4b29-bde9-85cf198cabf0', '1e621617-c129-4612-8c77-52b2900c7c59', '6f8a4673-59c5-493b-8250-617958bf996b', 'd9146aa9-dd0d-4b6f-a4e4-ae53b242a9de', '5333cddc-c089-40b3-9eba-dc3f40477cac', 'a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748', 'e56a9d58-7904-4a6e-8dc7-f39e99c54ed0', '572a619a-3a59-46a6-bc09-5d754276356e', 'd189cef5-279a-45d3-a52a-a0fb084ee3fa', '0baaf456-ebe4-4944-a9c9-d343bf8ebd98', '0d98818b-c2c5-4242-8897-fe65d03027a5', '73383895-5111-42cc-a071-b2512b2f23af', '16fadac6-f5a2-4997-b67b-221b3b4e45a8', 'ca27a1b0-973f-4958-8f7f-a5c216cb9a8c', 'ab1f82be-3036-4adf-bad7-5cfb8bab5684', 'ff280f19-627b-45ca-afac-7d9154581e89', 'd45dc5c0-5228-4870-b34a-e7555a457f95', '0776053c-3635-4232-86b2-1a586b64e542', '0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6', '7a9726c0-7c30-4b11-81a1-9a9fcc702273', '2989abf8-9869-43ad-95d4-6dd97b3a3deb', '667765ac-1a17-4f77-a3e3-a4d9d12ca600', '6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5', '86efc288-b26f-4298-9444-58202b5c40d5', 'd1b8da2b-4abc-407f-9635-008e18b53627', '12839468-1e74-4c74-abf4-73e096a46e61', 'f422a68f-f64a-4d93-9deb-289ae02aea3a', 'a4f3ddc1-2b27-4b61-95d8-aac256599271', '2c2da01b-6452-4ea7-a1ca-fac9de38da7b', 'f6998667-5e88-456a-b064-7faf8fc4bfd8', 'e555b24f-3b58-40b7-8837-06aac9343ba3', '48314c78-ef82-4312-9437-4a43cc3de63d', 'e99a11c8-f108-4784-aa19-9139eb46ce97', '5a7abade-e912-4196-b558-4a6d4ece9b29', 'df2a8892-05ec-4200-8b30-e8813181f4e5'} {{(pid=70013) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1310.329324] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1310.346704] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.346855] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.346909] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.347142] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.347210] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.347266] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1310.347331] env[70013]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70013) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1310.347405] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1310.419616] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.419809] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.419844] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.420047] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.421782] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.422111] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1310.422193] env[70013]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70013) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1310.422267] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1310.422335] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1310.422539] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/41 resources of Type:Security Group Rules [ 1310.422662] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGH for action security_group_rules [ 1310.422748] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 with Priority: HIGH for action security_group_rules [ 1310.422815] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 with Priority: HIGH for action security_group_rules [ 1310.422881] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 with Priority: HIGH for action security_group_rules [ 1310.422944] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 250f9011-1d0c-4c88-9907-8d448831417a with Priority: HIGH for action security_group_rules [ 1310.423013] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9378f72e-568d-4e53-8f92-4547bbc2beb3 with Priority: HIGH for action security_group_rules [ 1310.423080] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 with Priority: HIGH for action security_group_rules [ 1310.423141] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1e621617-c129-4612-8c77-52b2900c7c59 with Priority: HIGH for action security_group_rules [ 1310.423203] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGH for action security_group_rules [ 1310.423266] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de with Priority: HIGH for action security_group_rules [ 1310.423329] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5333cddc-c089-40b3-9eba-dc3f40477cac with Priority: HIGH for action security_group_rules [ 1310.423391] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 with Priority: HIGH for action security_group_rules [ 1310.423454] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 with Priority: HIGH for action security_group_rules [ 1310.423520] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 572a619a-3a59-46a6-bc09-5d754276356e with Priority: HIGH for action security_group_rules [ 1310.423583] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d189cef5-279a-45d3-a52a-a0fb084ee3fa with Priority: HIGH for action security_group_rules [ 1310.423647] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0baaf456-ebe4-4944-a9c9-d343bf8ebd98 with Priority: HIGH for action security_group_rules [ 1310.423710] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 with Priority: HIGH for action security_group_rules [ 1310.423773] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 73383895-5111-42cc-a071-b2512b2f23af with Priority: HIGH for action security_group_rules [ 1310.423838] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 with Priority: HIGH for action security_group_rules [ 1310.423902] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c with Priority: HIGH for action security_group_rules [ 1310.423996] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.504927] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.505125] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.505191] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.505645] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.505645] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.505645] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 is going to be updated. [ 1310.531502] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.531715] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.531715] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.531918] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.532075] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.541035] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: IN_PROGRESS for 2s [ 1312.551796] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: SUCCESS [ 1312.552090] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.552202] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.552419] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.552608] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.552723] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.552796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.552952] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.553042] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.553128] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.553221] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.055794] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.055955] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.056048] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.056373] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.056446] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.056907] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.056907] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.056907] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.056907] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.056907] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.057080] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.057127] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.057175] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.057313] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.057444] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.057550] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.057608] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.057743] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.057817] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.057897] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.057988] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.362545] env[70013]: INFO networking_nsxv3.common.synchronization [None req-b660a41e-598b-4c05-8260-16ca1af69578 None None] Enqueued Resource ID: 2fc16a36-942f-4c52-b8dc-a6013e1b4be9 with Priority: HIGHEST for action port [ 1313.362819] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc16a36-942f-4c52-b8dc-a6013e1b4be9 with Priority: HIGHEST for action port [ 1313.362963] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c877e7-f731-49a5-b994-7d74c36c464b with Priority: HIGH for action security_group_rules [ 1313.363100] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 with Priority: HIGH for action security_group_rules [ 1313.363209] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 with Priority: HIGH for action security_group_rules [ 1313.363306] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d189cef5-279a-45d3-a52a-a0fb084ee3fa with Priority: HIGH for action security_group_rules [ 1313.363401] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c with Priority: HIGH for action security_group_rules [ 1313.363492] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 with Priority: HIGH for action security_group_rules [ 1313.363585] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73383895-5111-42cc-a071-b2512b2f23af with Priority: HIGH for action security_group_rules [ 1313.363674] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 with Priority: HIGH for action security_group_rules [ 1313.363763] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 572a619a-3a59-46a6-bc09-5d754276356e with Priority: HIGH for action security_group_rules [ 1313.363853] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0baaf456-ebe4-4944-a9c9-d343bf8ebd98 with Priority: HIGH for action security_group_rules [ 1313.363970] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 with Priority: HIGH for action security_group_rules [ 1313.364086] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 with Priority: HIGH for action security_group_rules [ 1313.364178] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5333cddc-c089-40b3-9eba-dc3f40477cac with Priority: HIGH for action security_group_rules [ 1313.364266] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de with Priority: HIGH for action security_group_rules [ 1313.364356] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f8a4673-59c5-493b-8250-617958bf996b with Priority: HIGH for action security_group_rules [ 1313.364444] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9378f72e-568d-4e53-8f92-4547bbc2beb3 with Priority: HIGH for action security_group_rules [ 1313.364534] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e621617-c129-4612-8c77-52b2900c7c59 with Priority: HIGH for action security_group_rules [ 1313.364624] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250f9011-1d0c-4c88-9907-8d448831417a with Priority: HIGH for action security_group_rules [ 1313.364742] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 with Priority: HIGH for action security_group_rules [ 1313.364792] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 with Priority: HIGH for action security_group_rules [ 1313.365368] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fc16a36-942f-4c52-b8dc-a6013e1b4be9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.365845] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fc16a36-942f-4c52-b8dc-a6013e1b4be9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.365845] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fc16a36-942f-4c52-b8dc-a6013e1b4be9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.365990] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fc16a36-942f-4c52-b8dc-a6013e1b4be9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.365990] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fc16a36-942f-4c52-b8dc-a6013e1b4be9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.366805] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16c877e7-f731-49a5-b994-7d74c36c464b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.366953] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.367102] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.367417] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.367417] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16c877e7-f731-49a5-b994-7d74c36c464b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.368885] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b51e70d-5edb-4332-99e9-eb53e6015365 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.369185] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.369185] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.369441] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.369441] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b51e70d-5edb-4332-99e9-eb53e6015365',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.370136] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f3400e9-8b30-4b29-bde9-85cf198cabf0 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.370248] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.370496] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.370496] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.370604] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f3400e9-8b30-4b29-bde9-85cf198cabf0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.371183] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d189cef5-279a-45d3-a52a-a0fb084ee3fa taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.371277] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.371348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.371528] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.371603] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d189cef5-279a-45d3-a52a-a0fb084ee3fa',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.372265] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.372371] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.372436] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.372616] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.372676] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca27a1b0-973f-4958-8f7f-a5c216cb9a8c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.373333] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16fadac6-f5a2-4997-b67b-221b3b4e45a8 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.373441] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.373510] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.373773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.373773] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16fadac6-f5a2-4997-b67b-221b3b4e45a8',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.374504] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73383895-5111-42cc-a071-b2512b2f23af taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.374719] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.374719] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.374864] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.374914] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73383895-5111-42cc-a071-b2512b2f23af',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.375530] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d98818b-c2c5-4242-8897-fe65d03027a5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.375680] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.375680] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.375873] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.375974] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d98818b-c2c5-4242-8897-fe65d03027a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.376646] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-572a619a-3a59-46a6-bc09-5d754276356e taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.376742] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.377062] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.377348] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.377348] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('572a619a-3a59-46a6-bc09-5d754276356e',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.378106] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0baaf456-ebe4-4944-a9c9-d343bf8ebd98 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.378273] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.378273] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.378420] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.378505] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0baaf456-ebe4-4944-a9c9-d343bf8ebd98',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.379191] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.379299] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.379346] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.379500] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.379576] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e56a9d58-7904-4a6e-8dc7-f39e99c54ed0',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.380235] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.380363] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.380432] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.380604] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.380736] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.381329] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5333cddc-c089-40b3-9eba-dc3f40477cac taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.381528] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.381528] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.381635] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.381804] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5333cddc-c089-40b3-9eba-dc3f40477cac',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.383798] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.383926] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.383984] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.384128] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.384244] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.384854] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f8a4673-59c5-493b-8250-617958bf996b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.384957] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.385065] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.385350] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.385350] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f8a4673-59c5-493b-8250-617958bf996b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.385878] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9378f72e-568d-4e53-8f92-4547bbc2beb3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.386023] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.386108] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.386218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.386309] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9378f72e-568d-4e53-8f92-4547bbc2beb3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.386948] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e621617-c129-4612-8c77-52b2900c7c59 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.387069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.387137] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.387286] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.387358] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e621617-c129-4612-8c77-52b2900c7c59',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.390944] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-250f9011-1d0c-4c88-9907-8d448831417a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.390944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.390944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.390944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.390944] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('250f9011-1d0c-4c88-9907-8d448831417a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.390944] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.390944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.390944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.390944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.390944] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7aa9a6a3-3934-4ea9-b361-0efe923f4669',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.390944] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d0cfefe-0851-47aa-9a55-0d92164acbc1 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.390944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.390944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.390944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.390944] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d0cfefe-0851-47aa-9a55-0d92164acbc1',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.561440] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4f3ddc1-2b27-4b61-95d8-aac256599271: rpc.has_security_group_logging(os_id): False [ 1313.577416] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.577709] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.577798] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.578033] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.595072] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.595368] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.595526] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.595587] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.595733] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.595822] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.596055] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.596162] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.596592] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.596592] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.596592] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.596699] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.596753] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.596779] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.596918] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.596993] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.597096] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 is going to be updated. [ 1313.654472] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.654662] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.654724] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.655562] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.655562] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.667704] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: IN_PROGRESS for 2s [ 1313.896931] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.897133] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.897133] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.897275] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.897422] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.897584] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.897652] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.897822] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.897910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.897997] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.898094] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca27a1b0-973f-4958-8f7f-a5c216cb9a8c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.903759] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2fc16a36-942f-4c52-b8dc-a6013e1b4be9 [ 1313.903759] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.903759] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.903994] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.903994] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.904061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.904118] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2fc16a36-942f-4c52-b8dc-a6013e1b4be9 already deleted. [ 1313.904198] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fc16a36-942f-4c52-b8dc-a6013e1b4be9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.906501] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aa9a6a3-3934-4ea9-b361-0efe923f4669 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.906626] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.906682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.906845] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.907036] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.907189] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.907241] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.907349] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.907430] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.907684] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.907929] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7aa9a6a3-3934-4ea9-b361-0efe923f4669',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.909741] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e621617-c129-4612-8c77-52b2900c7c59 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.910104] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.910104] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.910216] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.910284] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.910360] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.910944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.910944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.910944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.910944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.910944] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e621617-c129-4612-8c77-52b2900c7c59',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.926265] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca27a1b0-973f-4958-8f7f-a5c216cb9a8c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.953052] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.953203] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.953247] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.953436] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.965379] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.965514] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.966442] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.966442] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.968723] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.968723] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.970845] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.970941] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.971641] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.971740] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.973512] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.973512] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.973863] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.973944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.974628] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.974725] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.976268] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.976392] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.977369] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.977471] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.978690] env[70013]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1313.979111] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.979218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.980519] env[70013]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1313.980936] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.981042] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.981726] env[70013]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1313.983747] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.983747] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.985122] env[70013]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1313.985495] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.985736] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.988553] env[70013]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1313.988553] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.988553] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.988553] env[70013]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1313.988794] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.988794] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.991762] env[70013]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1313.991762] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.991762] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de is going to be deleted. [ 1313.992265] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.992472] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.011347] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.011494] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d98818b-c2c5-4242-8897-fe65d03027a5 is going to be deleted. [ 1314.012330] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.012535] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.030450] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.030577] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 572a619a-3a59-46a6-bc09-5d754276356e is going to be deleted. [ 1314.034019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.034019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.046779] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.046922] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.049651] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.049787] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0baaf456-ebe4-4944-a9c9-d343bf8ebd98 is going to be deleted. [ 1314.050618] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.050817] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.067976] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.068200] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.069265] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.069384] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16c877e7-f731-49a5-b994-7d74c36c464b is going to be deleted. [ 1314.070255] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.070465] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.075738] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.075831] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.114295] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.114422] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d189cef5-279a-45d3-a52a-a0fb084ee3fa is going to be deleted. [ 1314.115324] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.115576] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.207295] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.207436] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5333cddc-c089-40b3-9eba-dc3f40477cac is going to be deleted. [ 1314.208405] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.208615] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.235719] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.235900] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.236479] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.236577] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.251044] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.251117] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.252970] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.253102] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f8a4673-59c5-493b-8250-617958bf996b is going to be deleted. [ 1314.253937] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.254161] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.261523] env[70013]: INFO networking_nsxv3.common.synchronization [None req-d6e7ab13-33d3-4451-9595-9bf5a71ec768 tempest-ServerActionsTestOtherB-172314067 tempest-ServerActionsTestOtherB-172314067-project-member] Enqueued Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_rules [ 1314.261637] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_rules [ 1314.262172] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.262290] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.262358] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.262928] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.262928] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.284681] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.284766] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9378f72e-568d-4e53-8f92-4547bbc2beb3 is going to be deleted. [ 1314.285664] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.285877] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.328706] env[70013]: INFO networking_nsxv3.common.synchronization [None req-6e2cc6d2-317d-4532-90e7-6605c16e13a6 tempest-ServerActionsTestOtherB-172314067 tempest-ServerActionsTestOtherB-172314067-project-member] Enqueued Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_rules [ 1314.328706] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_rules [ 1314.328706] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.328706] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.390304] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.390458] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.393632] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.393632] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f3400e9-8b30-4b29-bde9-85cf198cabf0 is going to be deleted. [ 1314.394846] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.396148] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.419396] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e621617-c129-4612-8c77-52b2900c7c59',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.425086] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7aa9a6a3-3934-4ea9-b361-0efe923f4669',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.433759] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.434035] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 250f9011-1d0c-4c88-9907-8d448831417a is going to be deleted. [ 1314.435092] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.435315] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.441124] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca27a1b0-973f-4958-8f7f-a5c216cb9a8c: rpc.has_security_group_logging(os_id): False [ 1314.473325] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.473445] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.480578] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.480682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.488254] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.488254] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d0cfefe-0851-47aa-9a55-0d92164acbc1 is going to be deleted. [ 1314.489049] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.489264] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.550122] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.550257] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748 is going to be deleted. [ 1314.551178] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.551396] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.554714] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.554983] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.590912] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.591325] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.605641] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.605771] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b51e70d-5edb-4332-99e9-eb53e6015365 is going to be deleted. [ 1314.606670] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.606885] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.640900] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.640900] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.651103] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.651103] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.676045] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.676144] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73383895-5111-42cc-a071-b2512b2f23af is going to be deleted. [ 1314.677177] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.677303] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.737542] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.737749] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.743909] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.744052] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.749314] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.749450] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16fadac6-f5a2-4997-b67b-221b3b4e45a8 is going to be deleted. [ 1314.750455] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.750681] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.832148] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.832298] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e56a9d58-7904-4a6e-8dc7-f39e99c54ed0 is going to be deleted. [ 1314.833226] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.833441] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.833534] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.833671] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9146aa9-dd0d-4b6f-a4e4-ae53b242a9de" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.833830] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.834011] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.834240] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.834366] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d98818b-c2c5-4242-8897-fe65d03027a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.834833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.834999] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.835096] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.835212] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-572a619a-3a59-46a6-bc09-5d754276356e" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.835337] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.835482] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.835559] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.835669] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0baaf456-ebe4-4944-a9c9-d343bf8ebd98" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.835792] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.835930] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.836014] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.836278] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16c877e7-f731-49a5-b994-7d74c36c464b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.836407] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.836551] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.836632] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.836744] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d189cef5-279a-45d3-a52a-a0fb084ee3fa" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.836879] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.837042] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.837123] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.837235] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5333cddc-c089-40b3-9eba-dc3f40477cac" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.837357] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.837517] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.837596] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.837712] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f8a4673-59c5-493b-8250-617958bf996b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.837827] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.837968] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.853583] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.853712] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.861737] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.861835] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.883970] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.884100] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.892695] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.892975] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.893084] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.893173] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.893396] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.893486] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.893624] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c is going to be updated. [ 1314.894650] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.894829] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.894914] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.895086] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9378f72e-568d-4e53-8f92-4547bbc2beb3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.895166] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.895315] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.895395] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.895505] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f3400e9-8b30-4b29-bde9-85cf198cabf0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.895712] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.895776] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.895853] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.895964] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-250f9011-1d0c-4c88-9907-8d448831417a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.896127] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.896298] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.896378] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.896487] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d0cfefe-0851-47aa-9a55-0d92164acbc1" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.896984] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.897187] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.897287] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.897423] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9dc5d1b-e6a9-4ce4-9dc7-5d2844f7a748" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.897609] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.897755] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.897834] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.897943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b51e70d-5edb-4332-99e9-eb53e6015365" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.898085] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.898231] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.898308] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.898399] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 already deleted. [ 1314.898951] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.898951] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.898951] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.898951] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.899102] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73383895-5111-42cc-a071-b2512b2f23af" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.899139] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.899282] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.899355] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.899460] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16fadac6-f5a2-4997-b67b-221b3b4e45a8" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.899568] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.899708] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.899790] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.921208] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e621617-c129-4612-8c77-52b2900c7c59: rpc.has_security_group_logging(os_id): False [ 1314.926578] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7aa9a6a3-3934-4ea9-b361-0efe923f4669: rpc.has_security_group_logging(os_id): False [ 1314.990410] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.990653] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.990735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.990949] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.992493] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.992582] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.003641] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.003641] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.058424] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.058745] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.058847] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.058916] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.059144] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.059231] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.059362] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 is going to be updated. [ 1315.060372] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.060539] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.060645] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.060726] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e56a9d58-7904-4a6e-8dc7-f39e99c54ed0" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.060854] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.061052] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.065169] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.065169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.097657] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.097982] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.098170] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.098170] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.098414] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.098451] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.098540] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e621617-c129-4612-8c77-52b2900c7c59 is going to be updated. [ 1315.099556] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.099723] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.099908] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.145802] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c in Status: IN_PROGRESS for 2s [ 1315.175209] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.175356] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.175424] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.175665] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.175848] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.193215] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.193215] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.193368] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.193478] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.193619] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.202202] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 in Status: IN_PROGRESS for 2s [ 1315.207861] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e621617-c129-4612-8c77-52b2900c7c59 in Status: IN_PROGRESS for 2s [ 1315.419899] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.419899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.419899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.420092] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.421019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.421019] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 already deleted. [ 1315.421019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.433386] env[70013]: INFO networking_nsxv3.common.synchronization [None req-c635927e-3380-4474-b09a-77a86d30a66e None None] Enqueued Resource ID: 02389e83-62bd-45bd-8b81-566be8ed90b3 with Priority: HIGHEST for action port [ 1315.433664] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02389e83-62bd-45bd-8b81-566be8ed90b3 with Priority: HIGHEST for action port [ 1315.434240] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-02389e83-62bd-45bd-8b81-566be8ed90b3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.434362] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02389e83-62bd-45bd-8b81-566be8ed90b3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.434430] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02389e83-62bd-45bd-8b81-566be8ed90b3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.434672] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02389e83-62bd-45bd-8b81-566be8ed90b3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.434757] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02389e83-62bd-45bd-8b81-566be8ed90b3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.681042] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: SUCCESS [ 1315.681281] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.939938] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02389e83-62bd-45bd-8b81-566be8ed90b3 [ 1315.940211] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.940349] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.940414] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.940630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.940817] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.941009] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02389e83-62bd-45bd-8b81-566be8ed90b3 already deleted. [ 1315.941128] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02389e83-62bd-45bd-8b81-566be8ed90b3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.159739] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c in Status: SUCCESS [ 1317.160053] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.213691] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 in Status: SUCCESS [ 1317.213923] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.218616] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e621617-c129-4612-8c77-52b2900c7c59 in Status: SUCCESS [ 1317.218805] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.325199] env[70013]: INFO networking_nsxv3.common.synchronization [req-d7e49be6-ed9b-4918-b322-79e7fb5c0d89 req-51b562e3-19b6-47f5-a3e6-7c10e53fa957 tempest-ServerActionsTestOtherA-108106573 tempest-ServerActionsTestOtherA-108106573-project-member] Enqueued Resource ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c with Priority: HIGHEST for action security_group_members [ 1319.325616] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c with Priority: HIGHEST for action security_group_members [ 1319.325925] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.326066] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.326135] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.326333] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.326485] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.326582] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.326646] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.326794] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.326878] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.326967] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca27a1b0-973f-4958-8f7f-a5c216cb9a8c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.561450] env[70013]: INFO networking_nsxv3.common.synchronization [req-c8716c7f-7dd9-4500-804a-bc7602298f9d req-9f1ef0df-1eb1-41bd-acfb-84b063380847 tempest-ServerActionsTestOtherB-172314067 tempest-ServerActionsTestOtherB-172314067-project-member] Enqueued Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_members [ 1319.562012] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_members [ 1319.562327] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.562452] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.562514] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.562772] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.562926] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.563094] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.563094] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.563249] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.563329] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.563419] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.795138] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-847 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.795342] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-847" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.795490] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-847" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.795868] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-847" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.796097] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.796260] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.796379] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.796611] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.796754] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.796968] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1319.797101] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1319.797216] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1319.797325] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1319.797437] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1319.797561] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1319.797709] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1319.817649] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1319.817813] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1319.817955] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1319.818152] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-847" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.818431] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-c8b16039-3297-434c-ae9e-e75e6ee2965d taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.818596] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-c8b16039-3297-434c-ae9e-e75e6ee2965d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.818719] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-c8b16039-3297-434c-ae9e-e75e6ee2965d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.819023] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-c8b16039-3297-434c-ae9e-e75e6ee2965d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.819168] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8b16039-3297-434c-ae9e-e75e6ee2965d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.832269] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.832386] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.832459] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.832636] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.832724] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.832905] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.832998] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.833076] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.833229] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.833306] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.833392] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c is going to be updated. [ 1319.858217] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.858336] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.858418] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.858641] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.858788] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.866717] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c in Status: IN_PROGRESS for 2s [ 1320.066121] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.066288] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.066324] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.066526] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.066621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.066822] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.066925] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.066974] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.067149] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.067229] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.067317] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 already deleted. [ 1320.067398] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.322028] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.322028] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.322028] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.322028] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.322028] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.322273] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port c8b16039-3297-434c-ae9e-e75e6ee2965d not found, creating... [ 1320.322445] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.322613] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.322731] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.322953] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.323107] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.323394] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.323547] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.323663] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.323887] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.324037] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.324194] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: c8b16039-3297-434c-ae9e-e75e6ee2965d is going to be created. [ 1320.343318] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.343690] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.343690] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.344034] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.344283] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.344501] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-c8b16039-3297-434c-ae9e-e75e6ee2965d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.048211] env[70013]: INFO networking_nsxv3.common.synchronization [req-c8716c7f-7dd9-4500-804a-bc7602298f9d req-d06f568e-2f34-4d65-8548-761ad66243f1 service nova] Enqueued Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_rules [ 1321.048211] env[70013]: INFO networking_nsxv3.common.synchronization [req-c8716c7f-7dd9-4500-804a-bc7602298f9d req-d06f568e-2f34-4d65-8548-761ad66243f1 service nova] Enqueued Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_members [ 1321.048211] env[70013]: INFO networking_nsxv3.common.synchronization [req-c8716c7f-7dd9-4500-804a-bc7602298f9d req-d06f568e-2f34-4d65-8548-761ad66243f1 service nova] Enqueued Resource ID: c8b16039-3297-434c-ae9e-e75e6ee2965d with Priority: HIGHEST for action port [ 1321.048211] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_rules [ 1321.048211] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_members [ 1321.048211] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8b16039-3297-434c-ae9e-e75e6ee2965d with Priority: HIGHEST for action port [ 1321.048211] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.048211] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.048211] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.049218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.049419] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.051247] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.052117] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.052186] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.052373] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.052538] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.052639] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.052703] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.052855] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.052935] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.053037] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.053946] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8b16039-3297-434c-ae9e-e75e6ee2965d taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.053946] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8b16039-3297-434c-ae9e-e75e6ee2965d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.054070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8b16039-3297-434c-ae9e-e75e6ee2965d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.054145] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8b16039-3297-434c-ae9e-e75e6ee2965d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.054219] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8b16039-3297-434c-ae9e-e75e6ee2965d',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.556417] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.556682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.556743] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.557686] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c8b16039-3297-434c-ae9e-e75e6ee2965d with status ACTIVE [ 1321.557901] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.557978] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.558126] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.558265] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.558356] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.558522] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.558686] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.558770] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.558938] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.559297] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.559533] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.559744] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.559816] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.559972] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.560069] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.560155] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c8b16039-3297-434c-ae9e-e75e6ee2965d is going to be updated. [ 1321.591184] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.591401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.591401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.591700] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.591850] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.592012] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8b16039-3297-434c-ae9e-e75e6ee2965d" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.876768] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c in Status: SUCCESS [ 1321.876944] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c deletion is rescheduled due to dependency. [ 1321.877075] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.062965] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.565379] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.565775] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.565775] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.565858] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.566032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.566032] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 is going to be created. [ 1322.588019] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.588206] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.588245] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.588467] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.588635] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.597670] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 in Status: UNINITIALIZED for 2s [ 1324.608521] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 in Status: SUCCESS [ 1324.608919] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.609582] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.610039] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.610569] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.610762] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.611047] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.611130] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.611232] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.611369] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.611747] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.761423] env[70013]: INFO networking_nsxv3.common.synchronization [req-498e3b68-1ac5-4c16-a1ca-31ab2c527638 req-3aa27d87-6f28-4b3e-8ed2-0188411f4ec4 tempest-AttachInterfacesTestJSON-1580231832 tempest-AttachInterfacesTestJSON-1580231832-project-member] Enqueued Resource ID: 1e621617-c129-4612-8c77-52b2900c7c59 with Priority: HIGHEST for action security_group_members [ 1324.761934] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e621617-c129-4612-8c77-52b2900c7c59 with Priority: HIGHEST for action security_group_members [ 1324.762330] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e621617-c129-4612-8c77-52b2900c7c59 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.762476] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.762665] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.762920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.763113] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.765547] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.765547] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.765547] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.765547] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.765547] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e621617-c129-4612-8c77-52b2900c7c59',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.114008] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.267924] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e621617-c129-4612-8c77-52b2900c7c59',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.615863] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 923a7efd-ce94-46c5-bff5-df5bd6dfdb84: rpc.has_security_group_logging(os_id): False [ 1325.633400] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.633544] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.633620] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.633850] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.633943] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.634206] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.634305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.634367] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.634517] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.634593] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.634684] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 is going to be created. [ 1325.688474] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.688649] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.688686] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.688988] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.689225] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.698324] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 in Status: IN_PROGRESS for 2s [ 1325.773822] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e621617-c129-4612-8c77-52b2900c7c59',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.275939] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.276119] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.276196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.276429] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.276529] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.276696] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e621617-c129-4612-8c77-52b2900c7c59 is going to be updated. [ 1326.302942] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.303108] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.303140] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.303356] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.303466] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.311827] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e621617-c129-4612-8c77-52b2900c7c59 in Status: IN_PROGRESS for 2s [ 1327.709567] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 in Status: SUCCESS [ 1327.709907] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.321690] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e621617-c129-4612-8c77-52b2900c7c59 in Status: SUCCESS [ 1328.321690] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.763172] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1329.763541] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1331.189047] env[70013]: INFO networking_nsxv3.common.synchronization [req-7eed8cfc-65df-4ddd-befa-e9aaff693f9d req-9a3844d2-b52b-4363-9e8d-2aa66582e145 tempest-AttachInterfacesTestJSON-1580231832 tempest-AttachInterfacesTestJSON-1580231832-project-member] Enqueued Resource ID: 1e621617-c129-4612-8c77-52b2900c7c59 with Priority: HIGHEST for action security_group_members [ 1331.189047] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e621617-c129-4612-8c77-52b2900c7c59 with Priority: HIGHEST for action security_group_members [ 1331.189321] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e621617-c129-4612-8c77-52b2900c7c59 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.189413] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.189482] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.189691] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.191089] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.191089] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.191089] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.191089] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.191089] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.191293] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e621617-c129-4612-8c77-52b2900c7c59',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.693040] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.693234] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.693234] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.695536] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.695536] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.695536] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.695536] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.695536] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.695536] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.695536] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.695536] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e621617-c129-4612-8c77-52b2900c7c59 is going to be updated. [ 1331.723293] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.723423] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.723485] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.723692] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.723835] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.731352] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e621617-c129-4612-8c77-52b2900c7c59 in Status: IN_PROGRESS for 2s [ 1333.741565] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e621617-c129-4612-8c77-52b2900c7c59 in Status: SUCCESS [ 1333.741565] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e621617-c129-4612-8c77-52b2900c7c59 deletion is rescheduled due to dependency. [ 1333.741898] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.511700] env[70013]: INFO networking_nsxv3.common.synchronization [None req-627d5cca-8b11-44dc-a6ef-16b8e7b25e00 tempest-AttachInterfacesTestJSON-1580231832 tempest-AttachInterfacesTestJSON-1580231832-project-member] Enqueued Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_members [ 1335.512212] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGHEST for action security_group_members [ 1335.512521] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.512648] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.512710] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.512934] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.513113] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.513216] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.513277] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.513442] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.513518] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.513590] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.016191] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.016371] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.016466] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.016651] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.016748] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.016966] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.017079] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.017143] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.017317] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.017400] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.017503] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 is going to be updated. [ 1336.043417] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.043610] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.043610] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.043858] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.043996] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.061321] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: IN_PROGRESS for 2s [ 1338.071828] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 in Status: SUCCESS [ 1338.071828] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 deletion is rescheduled due to dependency. [ 1338.071828] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.513052] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1340.513052] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1345.162994] env[70013]: INFO networking_nsxv3.common.synchronization [req-0049cb66-5367-43f2-bf14-dea4bc899e14 req-01bc4a19-c2ca-440b-87b4-36b2724bf49f tempest-AttachVolumeShelveTestJSON-1114130730 tempest-AttachVolumeShelveTestJSON-1114130730-project-member] Enqueued Resource ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 with Priority: HIGHEST for action security_group_members [ 1345.163588] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 with Priority: HIGHEST for action security_group_members [ 1345.163936] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-7aa9a6a3-3934-4ea9-b361-0efe923f4669 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.164117] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.164731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.164731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.164731] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.164731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.164731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.164995] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.164995] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.165092] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7aa9a6a3-3934-4ea9-b361-0efe923f4669',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.667200] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.667398] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.667442] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.667648] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.667742] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.667981] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.668124] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.668160] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.668298] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.668375] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.668460] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 is going to be updated. [ 1345.697589] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.697713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.697713] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.697906] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.698052] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.705464] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 in Status: IN_PROGRESS for 2s [ 1347.715761] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 in Status: SUCCESS [ 1347.716101] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 deletion is rescheduled due to dependency. [ 1347.716101] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.785328] env[70013]: INFO networking_nsxv3.common.synchronization [None req-141f6928-95c7-4579-82b1-816355944034 tempest-AttachVolumeShelveTestJSON-1114130730 tempest-AttachVolumeShelveTestJSON-1114130730-project-member] Enqueued Resource ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 with Priority: HIGHEST for action security_group_rules [ 1349.785877] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 with Priority: HIGHEST for action security_group_rules [ 1349.786214] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.786340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.786407] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.786664] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.786748] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.851369] env[70013]: INFO networking_nsxv3.common.synchronization [None req-a9400f4f-b169-4e59-919d-c7fd7e5a3eb9 tempest-AttachVolumeShelveTestJSON-1114130730 tempest-AttachVolumeShelveTestJSON-1114130730-project-member] Enqueued Resource ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 with Priority: HIGHEST for action security_group_rules [ 1349.851843] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 with Priority: HIGHEST for action security_group_rules [ 1349.852420] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.852530] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.306525] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.306656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.306728] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.306938] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.307028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.307126] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 already deleted. [ 1350.307209] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.307351] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.307503] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.307586] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.827042] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.827042] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.827438] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.827438] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.827438] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.827545] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 already deleted. [ 1350.827573] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.853060] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1354.853060] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1355.032300] env[70013]: INFO networking_nsxv3.common.synchronization [req-8e69aa51-7735-404b-b532-e37e58f21689 req-8a00e03c-3d35-418e-9534-a531ae46efc0 tempest-AttachVolumeShelveTestJSON-1114130730 tempest-AttachVolumeShelveTestJSON-1114130730-project-member] Enqueued Resource ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 with Priority: HIGHEST for action security_group_members [ 1355.032881] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 with Priority: HIGHEST for action security_group_members [ 1355.033242] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.033391] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.033455] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.033717] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.033881] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.033986] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.034074] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.034275] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.034388] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.034598] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.269928] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-63 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.270155] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-63" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.270289] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-63" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.270558] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-63" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.270857] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.271024] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.271147] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.271364] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.271512] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.271730] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1355.271847] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1355.271959] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1355.272119] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1355.272240] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1355.272352] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1355.272488] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1355.292821] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1355.292983] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1355.293139] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1355.293310] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-63" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.293601] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-d6a9de80-b7ec-45e7-9bad-0e115b06a3b9 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.293795] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-d6a9de80-b7ec-45e7-9bad-0e115b06a3b9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.293877] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-d6a9de80-b7ec-45e7-9bad-0e115b06a3b9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.294188] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-d6a9de80-b7ec-45e7-9bad-0e115b06a3b9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.294329] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6a9de80-b7ec-45e7-9bad-0e115b06a3b9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.536723] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.536892] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.536936] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.537169] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.537265] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.537454] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.537553] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.537617] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.537772] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.537850] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.537934] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 already deleted. [ 1355.538053] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.796273] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.796516] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.796649] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.796950] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.797203] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.797337] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port d6a9de80-b7ec-45e7-9bad-0e115b06a3b9 not found, creating... [ 1355.797574] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.797731] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.797852] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.798149] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.798299] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.798587] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.798742] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.798860] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.799108] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.799420] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.799420] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: d6a9de80-b7ec-45e7-9bad-0e115b06a3b9 is going to be created. [ 1355.818372] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.818570] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.818684] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.818922] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.819184] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.819407] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-d6a9de80-b7ec-45e7-9bad-0e115b06a3b9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.480927] env[70013]: INFO networking_nsxv3.common.synchronization [req-8e69aa51-7735-404b-b532-e37e58f21689 req-c40aecf6-e434-4932-85e5-1124fd71c61d service nova] Enqueued Resource ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 with Priority: HIGHEST for action security_group_rules [ 1356.481178] env[70013]: INFO networking_nsxv3.common.synchronization [req-8e69aa51-7735-404b-b532-e37e58f21689 req-c40aecf6-e434-4932-85e5-1124fd71c61d service nova] Enqueued Resource ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 with Priority: HIGHEST for action security_group_members [ 1356.481270] env[70013]: INFO networking_nsxv3.common.synchronization [req-8e69aa51-7735-404b-b532-e37e58f21689 req-c40aecf6-e434-4932-85e5-1124fd71c61d service nova] Enqueued Resource ID: d6a9de80-b7ec-45e7-9bad-0e115b06a3b9 with Priority: HIGHEST for action port [ 1356.481499] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 with Priority: HIGHEST for action security_group_rules [ 1356.481637] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 with Priority: HIGHEST for action security_group_members [ 1356.481720] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6a9de80-b7ec-45e7-9bad-0e115b06a3b9 with Priority: HIGHEST for action port [ 1356.482419] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.482588] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.482689] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.482915] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.483096] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.483956] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.484150] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.484247] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.484470] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.484653] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.484782] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.484872] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.485085] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.485287] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.485405] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.486219] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6a9de80-b7ec-45e7-9bad-0e115b06a3b9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.486854] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6a9de80-b7ec-45e7-9bad-0e115b06a3b9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.486854] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6a9de80-b7ec-45e7-9bad-0e115b06a3b9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.486854] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6a9de80-b7ec-45e7-9bad-0e115b06a3b9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.486854] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6a9de80-b7ec-45e7-9bad-0e115b06a3b9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.988311] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.988454] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.988602] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.989497] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6a9de80-b7ec-45e7-9bad-0e115b06a3b9 with status ACTIVE [ 1356.989680] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.989796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.989863] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.990082] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.990177] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.990359] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.990462] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.990523] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.991196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.991196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.991196] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.991196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.991196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.991196] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.991419] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.991419] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6a9de80-b7ec-45e7-9bad-0e115b06a3b9 is going to be updated. [ 1357.012630] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.012761] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.012809] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.012993] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.013140] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.013316] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6a9de80-b7ec-45e7-9bad-0e115b06a3b9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.492987] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.995229] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.995437] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.995477] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.995686] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.995777] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.995878] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 is going to be created. [ 1358.021452] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.021610] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.021610] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.021872] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.022043] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.035212] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 in Status: UNINITIALIZED for 2s [ 1360.045090] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 in Status: SUCCESS [ 1360.045415] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.045415] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.045629] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.045813] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.045945] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.046030] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.046181] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.046263] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.046376] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.046427] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.548538] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.051215] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3: rpc.has_security_group_logging(os_id): False [ 1361.068154] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.068345] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.068394] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.068596] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.068683] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.068949] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.069089] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.069135] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.069307] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.069389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.069451] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 is going to be created. [ 1361.126406] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.126643] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.126643] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.126850] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.127025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.137028] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 in Status: IN_PROGRESS for 2s [ 1361.482836] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1361.482971] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1363.149897] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 in Status: SUCCESS [ 1363.152016] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.484666] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1366.485043] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1371.485386] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1371.485660] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1376.486417] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1376.486780] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1381.488050] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1381.488050] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1386.489106] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1386.489460] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1391.490166] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1391.490499] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1396.491995] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1396.492360] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1401.493390] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1401.493637] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1406.494640] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1406.494974] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1411.496445] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1411.496445] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1416.497819] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1416.498118] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1421.499540] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1421.499848] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1426.501235] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1426.501510] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1430.086074] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-63 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.086372] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-63" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.086451] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-63" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.086722] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-63" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.086995] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.087162] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.087282] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.087505] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.087661] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.087877] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1430.087995] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1430.088118] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1430.088230] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1430.088344] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1430.088451] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1430.088582] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1430.113697] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1430.113879] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1430.114014] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1430.114200] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-63" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.114506] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-d6a9de80-b7ec-45e7-9bad-0e115b06a3b9 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.114676] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-d6a9de80-b7ec-45e7-9bad-0e115b06a3b9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.114798] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-d6a9de80-b7ec-45e7-9bad-0e115b06a3b9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.115055] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-d6a9de80-b7ec-45e7-9bad-0e115b06a3b9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.115196] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6a9de80-b7ec-45e7-9bad-0e115b06a3b9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.617326] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.617525] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.617647] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.617903] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.618070] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.618365] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.618526] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.618649] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.618918] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.619074] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.619354] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.619512] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.619632] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.619849] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.619999] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.620171] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: d6a9de80-b7ec-45e7-9bad-0e115b06a3b9 is going to be updated. [ 1430.639601] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.639756] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.639878] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.640144] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.640339] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.640544] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-d6a9de80-b7ec-45e7-9bad-0e115b06a3b9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.289419] env[70013]: INFO networking_nsxv3.common.synchronization [req-bf494406-3636-4def-bc15-3fe2f7fe5966 req-97dce1fb-8614-4e7b-8a38-817afbe07ad7 service nova] Enqueued Resource ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 with Priority: HIGHEST for action security_group_rules [ 1431.289703] env[70013]: INFO networking_nsxv3.common.synchronization [req-bf494406-3636-4def-bc15-3fe2f7fe5966 req-97dce1fb-8614-4e7b-8a38-817afbe07ad7 service nova] Enqueued Resource ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 with Priority: HIGHEST for action security_group_members [ 1431.289787] env[70013]: INFO networking_nsxv3.common.synchronization [req-bf494406-3636-4def-bc15-3fe2f7fe5966 req-97dce1fb-8614-4e7b-8a38-817afbe07ad7 service nova] Enqueued Resource ID: d6a9de80-b7ec-45e7-9bad-0e115b06a3b9 with Priority: HIGHEST for action port [ 1431.290018] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 with Priority: HIGHEST for action security_group_rules [ 1431.290164] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 with Priority: HIGHEST for action security_group_members [ 1431.290262] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6a9de80-b7ec-45e7-9bad-0e115b06a3b9 with Priority: HIGHEST for action port [ 1431.290818] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.290922] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.291016] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.291242] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.291330] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1431.292127] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.292242] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.292303] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.292473] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.292616] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.292708] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.292771] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.292909] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.293081] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.293111] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1431.293788] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6a9de80-b7ec-45e7-9bad-0e115b06a3b9 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.293892] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6a9de80-b7ec-45e7-9bad-0e115b06a3b9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.293962] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6a9de80-b7ec-45e7-9bad-0e115b06a3b9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.294125] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6a9de80-b7ec-45e7-9bad-0e115b06a3b9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.294200] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6a9de80-b7ec-45e7-9bad-0e115b06a3b9',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1431.796456] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1431.797477] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.797630] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.799066] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6a9de80-b7ec-45e7-9bad-0e115b06a3b9 with status ACTIVE [ 1431.799232] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.799338] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.799400] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.799604] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.799748] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.799853] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.799944] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.800035] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.800194] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.800273] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.800450] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.800582] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.800628] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.800732] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.800804] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.800886] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6a9de80-b7ec-45e7-9bad-0e115b06a3b9 is going to be updated. [ 1431.824446] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1431.824593] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1431.824654] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1431.824831] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1431.824965] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1431.825131] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6a9de80-b7ec-45e7-9bad-0e115b06a3b9" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.299035] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1432.801462] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.801665] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.801759] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.801957] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.802093] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.802196] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 is going to be updated. [ 1432.832063] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1432.832242] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1432.832279] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1432.832506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1432.832664] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1432.842332] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 in Status: IN_PROGRESS for 2s [ 1434.852596] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 in Status: SUCCESS [ 1434.852949] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.852990] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.853204] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.853396] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1434.853511] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1434.853570] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1434.853724] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1434.853809] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.853894] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1434.853987] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1435.356326] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1435.858499] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3: rpc.has_security_group_logging(os_id): False [ 1435.875558] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.875752] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.875752] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.875979] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.876096] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.876355] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.876468] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.876528] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.876660] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.876737] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.876815] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 is going to be updated. [ 1435.929882] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.930123] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.930250] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.930542] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.930771] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.942703] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 in Status: IN_PROGRESS for 2s [ 1436.291649] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1436.291779] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1437.959497] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 in Status: SUCCESS [ 1437.959935] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.292605] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1441.293055] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1446.293772] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1446.294116] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1449.691546] env[70013]: INFO networking_nsxv3.common.synchronization [req-ba0045d5-645a-429a-9bb1-4195db35d933 req-f645ed9f-1d1b-4a22-976c-7f882376bf59 tempest-ServerActionsTestOtherB-172314067 tempest-ServerActionsTestOtherB-172314067-project-member] Enqueued Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_members [ 1449.692066] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_members [ 1449.692377] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.692634] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.693506] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.693744] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.693912] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.694032] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.694103] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.694272] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.694357] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.694726] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1450.197063] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.197063] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.197063] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.197420] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.197525] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.197858] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.197858] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.198041] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.198073] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.198131] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.198219] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 is going to be updated. [ 1450.225121] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1450.225255] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1450.225255] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1450.225409] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1450.225541] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1450.232853] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 in Status: IN_PROGRESS for 2s [ 1452.242743] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 in Status: SUCCESS [ 1452.243111] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 deletion is rescheduled due to dependency. [ 1452.243111] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1454.692819] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1454.693177] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1458.726561] env[70013]: INFO networking_nsxv3.common.synchronization [req-5a5bf1e2-34d5-43d0-bd4f-4f98f3d582c9 req-dd0fa629-5071-42e9-b893-667d3c729667 tempest-ServerActionsTestOtherB-172314067 tempest-ServerActionsTestOtherB-172314067-project-member] Enqueued Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_members [ 1458.727081] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_members [ 1458.727388] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.727510] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.727577] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.727773] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.727918] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.728014] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.728091] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.728242] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.728321] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.728420] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1458.960160] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-847 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.960378] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-847" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.960509] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-847" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.960782] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-847" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.961058] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.961221] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.961343] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.961566] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.961710] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.961919] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1458.962047] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1458.962162] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1458.962297] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1458.962482] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1458.962534] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1458.962663] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1458.981769] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1458.981936] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1458.982087] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1458.982282] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-847" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.982582] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-2c631bbd-dc11-42e5-9974-ae8b9992a1a5 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.982864] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-2c631bbd-dc11-42e5-9974-ae8b9992a1a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.982864] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-2c631bbd-dc11-42e5-9974-ae8b9992a1a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.983278] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-2c631bbd-dc11-42e5-9974-ae8b9992a1a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.983432] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c631bbd-dc11-42e5-9974-ae8b9992a1a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1459.231250] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.231417] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.231504] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.231699] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.231789] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.231980] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.232090] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.232146] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.232297] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.232376] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.232463] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 is going to be updated. [ 1459.255873] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.256070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.256070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.256250] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.256411] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.264206] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 in Status: IN_PROGRESS for 2s [ 1459.486021] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.486336] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.486391] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.486675] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.486864] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.487224] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port 2c631bbd-dc11-42e5-9974-ae8b9992a1a5 not found, creating... [ 1459.487321] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.487487] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.487611] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.487841] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.487984] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.488289] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.488466] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.488594] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.489055] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.489269] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.489432] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: 2c631bbd-dc11-42e5-9974-ae8b9992a1a5 is going to be created. [ 1459.509293] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1459.509493] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1459.509624] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1459.509888] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1459.510162] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1459.510461] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-2c631bbd-dc11-42e5-9974-ae8b9992a1a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.168151] env[70013]: INFO networking_nsxv3.common.synchronization [req-5a5bf1e2-34d5-43d0-bd4f-4f98f3d582c9 req-daf7adac-521c-4118-94b2-8205dccdb254 service nova] Enqueued Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_rules [ 1460.168451] env[70013]: INFO networking_nsxv3.common.synchronization [req-5a5bf1e2-34d5-43d0-bd4f-4f98f3d582c9 req-daf7adac-521c-4118-94b2-8205dccdb254 service nova] Enqueued Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_members [ 1460.168563] env[70013]: INFO networking_nsxv3.common.synchronization [req-5a5bf1e2-34d5-43d0-bd4f-4f98f3d582c9 req-daf7adac-521c-4118-94b2-8205dccdb254 service nova] Enqueued Resource ID: 2c631bbd-dc11-42e5-9974-ae8b9992a1a5 with Priority: HIGHEST for action port [ 1460.168711] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_rules [ 1460.168843] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_members [ 1460.168940] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c631bbd-dc11-42e5-9974-ae8b9992a1a5 with Priority: HIGHEST for action port [ 1460.169549] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.169675] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.169735] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.169940] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.170031] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1460.170867] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.170960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.171163] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c631bbd-dc11-42e5-9974-ae8b9992a1a5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.171264] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c631bbd-dc11-42e5-9974-ae8b9992a1a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.171330] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c631bbd-dc11-42e5-9974-ae8b9992a1a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.171525] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c631bbd-dc11-42e5-9974-ae8b9992a1a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.171564] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c631bbd-dc11-42e5-9974-ae8b9992a1a5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1460.675038] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.675184] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.675379] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c631bbd-dc11-42e5-9974-ae8b9992a1a5 with status ACTIVE [ 1460.675556] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.675670] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.675737] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.675946] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.676078] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.676258] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.676354] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.676416] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.677075] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.677163] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.677357] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.677452] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.677519] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.677670] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.677746] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.677828] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c631bbd-dc11-42e5-9974-ae8b9992a1a5 is going to be updated. [ 1460.698921] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.699045] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.699119] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.699327] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.699461] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.700029] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c631bbd-dc11-42e5-9974-ae8b9992a1a5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.273582] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 in Status: SUCCESS [ 1461.273582] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 deletion is rescheduled due to dependency. [ 1461.273582] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.273935] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.273935] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.275151] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.275151] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.275151] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.275151] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.275151] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.275151] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1461.776780] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.279075] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.781398] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.781538] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.781623] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.781843] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.781938] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.782049] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 is going to be updated. [ 1462.807360] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.807511] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.807573] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.807785] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.807931] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.817406] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 in Status: IN_PROGRESS for 2s [ 1464.827914] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 in Status: SUCCESS [ 1464.828218] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.828306] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.828520] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.828703] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.828816] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.828877] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.829040] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.829121] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.829205] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.829325] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1465.170070] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1465.170233] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1465.332063] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1465.834408] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 923a7efd-ce94-46c5-bff5-df5bd6dfdb84: rpc.has_security_group_logging(os_id): False [ 1465.851179] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.851365] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.851422] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.851649] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.851758] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.852018] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.852174] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.852279] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.852507] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.852640] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.852755] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 is going to be updated. [ 1465.907634] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.907808] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.907808] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.907990] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.908140] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.923231] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 in Status: IN_PROGRESS for 2s [ 1467.941461] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 in Status: SUCCESS [ 1467.941804] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1470.171211] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1470.171479] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1475.173167] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1475.173570] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1480.174734] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1480.174990] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1482.751357] env[70013]: INFO networking_nsxv3.common.synchronization [req-41e4fdc7-3d22-474c-80a1-d081b9e386c4 req-4723c7cb-4465-472b-aa74-c40c5f2db73d tempest-AttachVolumeShelveTestJSON-1114130730 tempest-AttachVolumeShelveTestJSON-1114130730-project-member] Enqueued Resource ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 with Priority: HIGHEST for action security_group_members [ 1482.751357] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 with Priority: HIGHEST for action security_group_members [ 1482.751357] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.751357] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.751357] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.751357] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.751717] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1482.751717] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1482.751717] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1482.751810] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1482.751854] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1482.751939] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1483.254368] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.254603] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.254603] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.254783] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.254881] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.255087] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.255176] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.255255] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.255443] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.255522] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.255615] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 is going to be updated. [ 1483.280798] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1483.280957] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1483.280957] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1483.281099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1483.281231] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.289194] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 in Status: IN_PROGRESS for 2s [ 1485.300089] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 in Status: SUCCESS [ 1485.300489] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 deletion is rescheduled due to dependency. [ 1485.300489] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.751475] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1487.751475] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1492.752358] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1492.752696] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1497.752938] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1497.753379] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1501.825343] env[70013]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1501.825660] env[70013]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-78e8289d-91a6-418c-aecd-0f0be6f45b8f None None] NSXv3 Agent Agent loop - iteration:4 started [ 1502.753871] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1502.754070] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1507.755696] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1507.755696] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1512.756670] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1512.757067] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1517.757717] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1517.758108] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1522.759622] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1522.759973] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1527.760419] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1527.760918] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1532.761534] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1532.761866] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1537.763202] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1537.763561] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1542.764532] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1542.764872] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1547.766641] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1547.766641] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1547.775916] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1547.775916] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1547.775916] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1547.775916] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1547.775916] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1548.277798] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1548.780570] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1549.283351] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1549.283571] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1549.981592] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1549.981940] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1549.981940] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1549.982028] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1549.994944] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1549.995788] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1549.996570] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1550.037637] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.037774] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.037846] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.038062] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.052491] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.053245] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1550.053327] env[70013]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70013) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1550.053417] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1550.086087] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.086221] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.086270] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.086465] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.087146] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.087287] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1550.154806] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.154977] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.155044] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.155248] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.155553] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.155805] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1550.221356] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.221577] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.221577] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.221759] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.222065] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.222406] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:26. [ 1550.222505] env[70013]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'7aa9a6a3-3934-4ea9-b361-0efe923f4669', 'ca27a1b0-973f-4958-8f7f-a5c216cb9a8c', 'ab1f82be-3036-4adf-bad7-5cfb8bab5684', '923a7efd-ce94-46c5-bff5-df5bd6dfdb84', 'ff280f19-627b-45ca-afac-7d9154581e89', 'd45dc5c0-5228-4870-b34a-e7555a457f95', '0776053c-3635-4232-86b2-1a586b64e542', '0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6', '7a9726c0-7c30-4b11-81a1-9a9fcc702273', '2989abf8-9869-43ad-95d4-6dd97b3a3deb', '1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3', '1e621617-c129-4612-8c77-52b2900c7c59', '667765ac-1a17-4f77-a3e3-a4d9d12ca600', '6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5', '86efc288-b26f-4298-9444-58202b5c40d5', 'd1b8da2b-4abc-407f-9635-008e18b53627', '12839468-1e74-4c74-abf4-73e096a46e61', 'f422a68f-f64a-4d93-9deb-289ae02aea3a', 'a4f3ddc1-2b27-4b61-95d8-aac256599271', '2c2da01b-6452-4ea7-a1ca-fac9de38da7b', 'f6998667-5e88-456a-b064-7faf8fc4bfd8', 'e555b24f-3b58-40b7-8837-06aac9343ba3', '48314c78-ef82-4312-9437-4a43cc3de63d', 'e99a11c8-f108-4784-aa19-9139eb46ce97', '5a7abade-e912-4196-b558-4a6d4ece9b29', 'df2a8892-05ec-4200-8b30-e8813181f4e5'} {{(pid=70013) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1550.222590] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1550.240098] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.240263] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.240311] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.240547] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.240634] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.240738] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1550.240811] env[70013]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70013) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1550.240882] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1550.315371] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1550.315563] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1550.315563] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1550.315768] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1550.316883] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1550.317144] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1550.317222] env[70013]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70013) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1550.317294] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1550.317361] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1550.317438] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/26 resources of Type:Security Group Rules [ 1550.317512] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 with Priority: HIGH for action security_group_rules [ 1550.317591] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c with Priority: HIGH for action security_group_rules [ 1550.317658] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ab1f82be-3036-4adf-bad7-5cfb8bab5684 with Priority: HIGH for action security_group_rules [ 1550.317722] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGH for action security_group_rules [ 1550.317783] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ff280f19-627b-45ca-afac-7d9154581e89 with Priority: HIGH for action security_group_rules [ 1550.317844] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d45dc5c0-5228-4870-b34a-e7555a457f95 with Priority: HIGH for action security_group_rules [ 1550.317907] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0776053c-3635-4232-86b2-1a586b64e542 with Priority: HIGH for action security_group_rules [ 1550.317969] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGH for action security_group_rules [ 1550.318043] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7a9726c0-7c30-4b11-81a1-9a9fcc702273 with Priority: HIGH for action security_group_rules [ 1550.318107] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2989abf8-9869-43ad-95d4-6dd97b3a3deb with Priority: HIGH for action security_group_rules [ 1550.318167] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 with Priority: HIGH for action security_group_rules [ 1550.318231] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1e621617-c129-4612-8c77-52b2900c7c59 with Priority: HIGH for action security_group_rules [ 1550.318287] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 667765ac-1a17-4f77-a3e3-a4d9d12ca600 with Priority: HIGH for action security_group_rules [ 1550.318347] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 with Priority: HIGH for action security_group_rules [ 1550.318409] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGH for action security_group_rules [ 1550.318470] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d1b8da2b-4abc-407f-9635-008e18b53627 with Priority: HIGH for action security_group_rules [ 1550.318530] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 12839468-1e74-4c74-abf4-73e096a46e61 with Priority: HIGH for action security_group_rules [ 1550.318592] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGH for action security_group_rules [ 1550.318652] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGH for action security_group_rules [ 1550.318714] env[70013]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGH for action security_group_rules [ 1550.318808] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.767754] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1552.768174] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1552.768174] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 with Priority: HIGH for action security_group_rules [ 1552.768174] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab1f82be-3036-4adf-bad7-5cfb8bab5684 with Priority: HIGH for action security_group_rules [ 1552.768288] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0776053c-3635-4232-86b2-1a586b64e542 with Priority: HIGH for action security_group_rules [ 1552.768395] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86efc288-b26f-4298-9444-58202b5c40d5 with Priority: HIGH for action security_group_rules [ 1552.768507] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b with Priority: HIGH for action security_group_rules [ 1552.768602] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 with Priority: HIGH for action security_group_rules [ 1552.768696] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f422a68f-f64a-4d93-9deb-289ae02aea3a with Priority: HIGH for action security_group_rules [ 1552.768788] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12839468-1e74-4c74-abf4-73e096a46e61 with Priority: HIGH for action security_group_rules [ 1552.768876] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 with Priority: HIGH for action security_group_rules [ 1552.768963] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1b8da2b-4abc-407f-9635-008e18b53627 with Priority: HIGH for action security_group_rules [ 1552.769064] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 667765ac-1a17-4f77-a3e3-a4d9d12ca600 with Priority: HIGH for action security_group_rules [ 1552.769155] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e621617-c129-4612-8c77-52b2900c7c59 with Priority: HIGH for action security_group_rules [ 1552.769240] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 with Priority: HIGH for action security_group_rules [ 1552.769326] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2989abf8-9869-43ad-95d4-6dd97b3a3deb with Priority: HIGH for action security_group_rules [ 1552.769418] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a9726c0-7c30-4b11-81a1-9a9fcc702273 with Priority: HIGH for action security_group_rules [ 1552.769513] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d45dc5c0-5228-4870-b34a-e7555a457f95 with Priority: HIGH for action security_group_rules [ 1552.769603] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 with Priority: HIGH for action security_group_rules [ 1552.769686] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff280f19-627b-45ca-afac-7d9154581e89 with Priority: HIGH for action security_group_rules [ 1552.769772] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c with Priority: HIGH for action security_group_rules [ 1552.769859] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGH for action security_group_rules [ 1552.770222] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.770403] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.770484] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.770696] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.770776] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7aa9a6a3-3934-4ea9-b361-0efe923f4669',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.771731] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab1f82be-3036-4adf-bad7-5cfb8bab5684 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.771861] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.771897] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.772132] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.772132] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab1f82be-3036-4adf-bad7-5cfb8bab5684',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.773077] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0776053c-3635-4232-86b2-1a586b64e542 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.773183] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.773257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.773395] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.773488] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0776053c-3635-4232-86b2-1a586b64e542',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.774316] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-86efc288-b26f-4298-9444-58202b5c40d5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.774316] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.774401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.774526] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.774598] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('86efc288-b26f-4298-9444-58202b5c40d5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.775264] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c2da01b-6452-4ea7-a1ca-fac9de38da7b taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.775393] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.775426] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.775573] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.775757] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c2da01b-6452-4ea7-a1ca-fac9de38da7b',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.776297] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4f3ddc1-2b27-4b61-95d8-aac256599271 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.776403] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.776477] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.776639] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.776714] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4f3ddc1-2b27-4b61-95d8-aac256599271',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.778956] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f422a68f-f64a-4d93-9deb-289ae02aea3a taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.779060] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.779125] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.779276] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.779348] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f422a68f-f64a-4d93-9deb-289ae02aea3a',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.780020] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12839468-1e74-4c74-abf4-73e096a46e61 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.780129] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.780195] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.780342] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.780567] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12839468-1e74-4c74-abf4-73e096a46e61',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.781082] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.781189] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.781256] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.781410] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.781475] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.782133] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1b8da2b-4abc-407f-9635-008e18b53627 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.782239] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.782307] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.782466] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.782558] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1b8da2b-4abc-407f-9635-008e18b53627',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.901707] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-667765ac-1a17-4f77-a3e3-a4d9d12ca600 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.901930] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.901930] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.902166] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.902227] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('667765ac-1a17-4f77-a3e3-a4d9d12ca600',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.902958] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e621617-c129-4612-8c77-52b2900c7c59 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.903098] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.903179] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.903309] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.903377] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e621617-c129-4612-8c77-52b2900c7c59',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.904058] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.904183] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.904232] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.904375] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.904448] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.905170] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2989abf8-9869-43ad-95d4-6dd97b3a3deb taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.905271] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.905340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.905489] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.905564] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2989abf8-9869-43ad-95d4-6dd97b3a3deb',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.906304] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a9726c0-7c30-4b11-81a1-9a9fcc702273 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.906304] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.906389] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.906524] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.906581] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a9726c0-7c30-4b11-81a1-9a9fcc702273',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.907206] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d45dc5c0-5228-4870-b34a-e7555a457f95 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.907305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.907374] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.907513] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.907577] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d45dc5c0-5228-4870-b34a-e7555a457f95',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.908284] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.908403] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.908494] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.908650] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.908725] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.909365] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff280f19-627b-45ca-afac-7d9154581e89 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.909470] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.909534] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.909679] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.909749] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff280f19-627b-45ca-afac-7d9154581e89',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.910434] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.910539] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.910588] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.910733] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.910803] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca27a1b0-973f-4958-8f7f-a5c216cb9a8c',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.911523] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.911631] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.911698] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.911848] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.911922] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.958135] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.958338] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.958338] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.958547] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.960140] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.960262] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.960910] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.961020] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.961715] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.961804] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.962476] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.962566] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.963247] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.963426] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.963988] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.964090] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.965199] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.965299] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.977774] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.977884] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4f3ddc1-2b27-4b61-95d8-aac256599271 is going to be deleted. [ 1552.978644] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.978833] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.993710] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.993805] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c2da01b-6452-4ea7-a1ca-fac9de38da7b is going to be deleted. [ 1552.994534] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.994741] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.084846] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.084986] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7aa9a6a3-3934-4ea9-b361-0efe923f4669 is going to be deleted. [ 1553.085834] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.086064] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.099702] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.099844] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.105775] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.105902] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f422a68f-f64a-4d93-9deb-289ae02aea3a is going to be deleted. [ 1553.106691] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.106910] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.125597] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.125703] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12839468-1e74-4c74-abf4-73e096a46e61 is going to be deleted. [ 1553.126369] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.126552] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.140589] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.140727] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.141464] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.141560] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.144109] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.144222] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5 is going to be deleted. [ 1553.144987] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.145198] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.182122] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.182245] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab1f82be-3036-4adf-bad7-5cfb8bab5684 is going to be deleted. [ 1553.183051] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.183262] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.187654] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.187765] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.262059] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.262194] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0776053c-3635-4232-86b2-1a586b64e542 is going to be deleted. [ 1553.262899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.263110] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.263202] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.263317] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4f3ddc1-2b27-4b61-95d8-aac256599271" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.263966] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.264087] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.264155] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.264299] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.264378] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.264538] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12839468-1e74-4c74-abf4-73e096a46e61" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.264671] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.264818] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.264896] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.265010] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7aa9a6a3-3934-4ea9-b361-0efe923f4669" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.265417] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.265577] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.265657] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.265757] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c2da01b-6452-4ea7-a1ca-fac9de38da7b" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.265887] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.266038] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.266113] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.266212] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f422a68f-f64a-4d93-9deb-289ae02aea3a" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.278608] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.278744] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.278799] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.278925] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.278999] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.279116] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ec282d8-62cf-4e4e-ad6b-72dda99ba5b5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.354601] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.354724] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.354762] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.354941] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.355038] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.355152] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab1f82be-3036-4adf-bad7-5cfb8bab5684" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.403551] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.403721] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.403796] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.403931] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.404026] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.404150] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0776053c-3635-4232-86b2-1a586b64e542" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.425427] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.425547] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.425653] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.425823] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.425979] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.426099] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.426152] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.426283] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.426364] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.426447] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.426534] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1553.439181] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.439287] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.439398] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.439525] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.458177] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.458285] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.472016] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.472115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.489401] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.489499] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.500840] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.500956] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.501619] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.501726] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.502406] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.502505] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.510868] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.510984] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.514117] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.514234] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.514846] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.514942] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.515690] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.515784] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.534220] env[70013]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1553.534650] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.534766] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e621617-c129-4612-8c77-52b2900c7c59 is going to be deleted. [ 1553.535584] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.535783] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.585446] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.585584] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 667765ac-1a17-4f77-a3e3-a4d9d12ca600 is going to be deleted. [ 1553.586401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.586607] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.623076] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.623201] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 86efc288-b26f-4298-9444-58202b5c40d5 is going to be deleted. [ 1553.625046] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.625046] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.625487] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.625592] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.648685] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.648800] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3 is going to be deleted. [ 1553.649734] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.649805] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.666981] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.667115] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.680656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.680804] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a9726c0-7c30-4b11-81a1-9a9fcc702273 is going to be deleted. [ 1553.681762] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.681959] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.683316] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.683435] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.737933] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.738084] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2989abf8-9869-43ad-95d4-6dd97b3a3deb is going to be deleted. [ 1553.739112] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.739305] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.744071] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.744178] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.780155] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.780450] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.788017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.788133] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca27a1b0-973f-4958-8f7f-a5c216cb9a8c is going to be deleted. [ 1553.788848] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.789049] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.839308] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.839413] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6 is going to be deleted. [ 1553.840149] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.840340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.874039] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.874168] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.890656] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.890770] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff280f19-627b-45ca-afac-7d9154581e89 is going to be deleted. [ 1553.891567] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.891760] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.930278] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1553.932790] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.932790] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.942076] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1553.942076] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1b8da2b-4abc-407f-9635-008e18b53627 is going to be deleted. [ 1553.942076] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1553.942257] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1553.985268] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.985415] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.996724] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1553.996838] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1553.999986] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.000121] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d45dc5c0-5228-4870-b34a-e7555a457f95 is going to be deleted. [ 1554.000966] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.001205] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.001321] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.001482] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e621617-c129-4612-8c77-52b2900c7c59" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.001638] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.001799] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.001892] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.001990] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-667765ac-1a17-4f77-a3e3-a4d9d12ca600" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.002421] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.002597] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.002664] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.002779] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-86efc288-b26f-4298-9444-58202b5c40d5" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.002905] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.003070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.003147] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.003255] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c2d1740-2cbf-45b5-898c-c2cfaa6a41e3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.003380] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.003519] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.003592] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.003700] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a9726c0-7c30-4b11-81a1-9a9fcc702273" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.003822] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.003960] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.004045] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.004150] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2989abf8-9869-43ad-95d4-6dd97b3a3deb" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.004273] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.004409] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.004489] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.004592] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca27a1b0-973f-4958-8f7f-a5c216cb9a8c" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.004712] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.004846] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.004920] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.005036] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff280f19-627b-45ca-afac-7d9154581e89" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.005386] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.005537] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.005612] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.005714] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ffe5e4a-f4c4-4c6b-9067-a89f12f9c9f6" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.059944] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.060101] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.060172] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.060359] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.060474] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.060593] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1b8da2b-4abc-407f-9635-008e18b53627" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.119631] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.119805] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.119805] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.120019] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.120106] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.120224] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d45dc5c0-5228-4870-b34a-e7555a457f95" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.432469] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 923a7efd-ce94-46c5-bff5-df5bd6dfdb84: rpc.has_security_group_logging(os_id): False [ 1554.448958] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.449129] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.449202] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.449390] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.466053] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.466333] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.466442] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.466509] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.466687] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.466770] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.466858] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 is going to be updated. [ 1554.522751] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1554.522888] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1554.522924] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1554.523125] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1554.523266] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1554.533846] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 in Status: IN_PROGRESS for 2s [ 1555.003748] env[70013]: INFO networking_nsxv3.common.synchronization [req-3eea78f0-f11f-4523-bf57-08e94ed6da39 req-b09d499c-252d-433d-9902-0d52429a136c tempest-ServerActionsTestOtherB-172314067 tempest-ServerActionsTestOtherB-172314067-project-member] Enqueued Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_members [ 1555.004228] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_members [ 1555.004534] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.004658] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1555.004724] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1555.004919] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1555.005081] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.005180] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1555.005239] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1555.005387] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1555.005464] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1555.005555] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1555.509025] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.509025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1555.509025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1555.509025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1555.509025] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1555.509317] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.509317] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1555.509317] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1555.509414] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1555.509513] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1555.509700] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 is going to be updated. [ 1555.533997] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1555.534118] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1555.534192] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1555.534356] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1555.534486] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1555.541481] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 in Status: IN_PROGRESS for 2s [ 1556.548325] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 in Status: SUCCESS [ 1556.548731] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.550979] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 in Status: SUCCESS [ 1557.551254] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 deletion is rescheduled due to dependency. [ 1557.551291] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.005537] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1560.005891] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1562.903931] env[70013]: INFO networking_nsxv3.common.synchronization [req-84f20e4a-d6c6-4180-9ba6-1d3ad059fea3 req-09439e28-a4d5-4406-8d5f-15fa721614fc tempest-ServerActionsTestOtherB-172314067 tempest-ServerActionsTestOtherB-172314067-project-member] Enqueued Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_members [ 1562.904521] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_members [ 1562.904826] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.904948] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.905109] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.905336] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.905490] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1562.905581] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1562.905647] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1562.905818] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1562.905904] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1562.905995] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.153377] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-847 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.153586] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-847" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.153716] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-847" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.153986] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-847" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.154256] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.154412] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.154531] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.154743] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.154889] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.155120] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1563.155290] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1563.155344] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1563.155452] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1563.155564] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1563.155673] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1563.155804] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1563.175565] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1563.175740] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1563.175871] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1563.176077] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-847" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.176340] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-e6329052-d285-488b-88cb-7c16a57a7be3 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.176502] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-e6329052-d285-488b-88cb-7c16a57a7be3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.176623] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-e6329052-d285-488b-88cb-7c16a57a7be3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.176923] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-e6329052-d285-488b-88cb-7c16a57a7be3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.177084] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6329052-d285-488b-88cb-7c16a57a7be3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.409066] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.409262] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.409262] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.409468] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.409563] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.409757] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.409856] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.409911] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.410076] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.410154] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.410243] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 is going to be updated. [ 1563.434015] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.434153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.434193] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.434340] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.434464] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.443735] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 in Status: IN_PROGRESS for 2s [ 1563.678910] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.679167] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.679269] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.679594] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.679703] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.679859] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Segment Port e6329052-d285-488b-88cb-7c16a57a7be3 not found, creating... [ 1563.680144] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.680270] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.680389] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.680662] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.680803] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.681108] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.681268] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.681387] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.681598] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.681754] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.681873] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: e6329052-d285-488b-88cb-7c16a57a7be3 is going to be created. [ 1563.701769] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.701917] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.702053] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.702290] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.702508] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.702717] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-e6329052-d285-488b-88cb-7c16a57a7be3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.393697] env[70013]: INFO networking_nsxv3.common.synchronization [req-84f20e4a-d6c6-4180-9ba6-1d3ad059fea3 req-6bd554b1-5adf-4891-8cc9-e46f8aad8967 service nova] Enqueued Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_rules [ 1564.393986] env[70013]: INFO networking_nsxv3.common.synchronization [req-84f20e4a-d6c6-4180-9ba6-1d3ad059fea3 req-6bd554b1-5adf-4891-8cc9-e46f8aad8967 service nova] Enqueued Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_members [ 1564.393986] env[70013]: INFO networking_nsxv3.common.synchronization [req-84f20e4a-d6c6-4180-9ba6-1d3ad059fea3 req-6bd554b1-5adf-4891-8cc9-e46f8aad8967 service nova] Enqueued Resource ID: e6329052-d285-488b-88cb-7c16a57a7be3 with Priority: HIGHEST for action port [ 1564.394213] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_rules [ 1564.394304] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_members [ 1564.394405] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6329052-d285-488b-88cb-7c16a57a7be3 with Priority: HIGHEST for action port [ 1564.394973] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.395382] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.395498] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.395818] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.395969] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1564.396978] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.397153] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.397441] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6329052-d285-488b-88cb-7c16a57a7be3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.397593] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6329052-d285-488b-88cb-7c16a57a7be3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.397701] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6329052-d285-488b-88cb-7c16a57a7be3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.397929] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6329052-d285-488b-88cb-7c16a57a7be3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.398143] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6329052-d285-488b-88cb-7c16a57a7be3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1564.900944] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.901182] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.901463] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e6329052-d285-488b-88cb-7c16a57a7be3 with status ACTIVE [ 1564.901722] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.901894] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.901972] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.902643] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.902643] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.902643] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.902834] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.902834] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.903008] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.903058] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.903249] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.903346] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.903408] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.903555] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.903632] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.903716] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e6329052-d285-488b-88cb-7c16a57a7be3 is going to be updated. [ 1564.924786] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1564.924971] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1564.925061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1564.925319] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1564.925495] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1564.925701] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6329052-d285-488b-88cb-7c16a57a7be3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.452329] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 in Status: SUCCESS [ 1565.452636] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 deletion is rescheduled due to dependency. [ 1565.452636] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.452767] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.453026] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.453212] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.453362] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.453408] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.453547] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.453637] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.453746] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1565.955678] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1566.457878] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1566.959830] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1566.959984] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1566.960066] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1566.960283] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1566.960382] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1566.960526] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 is going to be updated. [ 1566.989398] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1566.989530] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1566.989628] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1566.989792] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1566.989935] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1567.001809] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 in Status: IN_PROGRESS for 2s [ 1569.012337] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 in Status: SUCCESS [ 1569.012602] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.012843] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.012935] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.013134] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1569.013246] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1569.013309] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1569.013459] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1569.013540] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.013632] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1569.013721] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1569.395458] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1569.395607] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1569.515957] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1570.019052] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 923a7efd-ce94-46c5-bff5-df5bd6dfdb84: rpc.has_security_group_logging(os_id): False [ 1570.035650] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.035812] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.035860] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.036072] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.036165] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.036408] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.036509] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.036571] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.036723] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.036799] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.036885] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 is going to be updated. [ 1570.094432] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1570.094577] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1570.094621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1570.094788] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1570.094917] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.106437] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 in Status: IN_PROGRESS for 2s [ 1572.120702] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 in Status: SUCCESS [ 1572.120702] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1574.397186] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1574.397539] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1579.398846] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1579.399236] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1584.399596] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1584.399949] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1589.400995] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1589.401404] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1594.402654] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1594.402654] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1599.403428] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1599.403825] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1604.404544] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1604.404913] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1609.405690] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1609.406095] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1614.407341] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1614.407682] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1619.409106] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1619.409521] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1624.410217] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1624.410572] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1629.411141] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1629.411550] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1634.412577] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1634.412902] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1634.780532] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock network-847 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1634.780833] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "network-847" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1634.781059] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "network-847" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1634.781420] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "network-847" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1634.781755] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1634.781998] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1634.782216] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1634.782516] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1634.782740] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1634.783038] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1634.783240] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] NeedRegenerationException {{(pid=70013) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1634.783435] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] no value, waiting for create lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1634.783629] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] value creation lock acquired {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1634.783830] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] No value present for key: 'zone-id' {{(pid=70013) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1634.784021] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Calling creation function for not-yet-present value {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1634.784250] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1634.833532] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1634.833690] env[70013]: DEBUG dogpile.cache.region [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Cache value generated in 0.049 seconds for key(s): 'zone-id' {{(pid=70013) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1634.833824] env[70013]: DEBUG dogpile.lock [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Released creation lock {{(pid=70013) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1634.833992] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "network-847" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1634.834303] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock port-e6329052-d285-488b-88cb-7c16a57a7be3 taken with stack trace [, , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1634.834472] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "port-e6329052-d285-488b-88cb-7c16a57a7be3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1634.834596] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "port-e6329052-d285-488b-88cb-7c16a57a7be3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1634.834836] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "port-e6329052-d285-488b-88cb-7c16a57a7be3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1634.834974] env[70013]: DEBUG networking_nsxv3.api.rpc [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6329052-d285-488b-88cb-7c16a57a7be3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1635.337620] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1635.338269] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1635.338269] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1635.338269] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1635.338415] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1635.338720] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1635.338881] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1635.339009] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1635.339228] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1635.339370] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1635.339670] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1635.339829] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1635.339948] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1635.340174] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1635.340311] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1635.340456] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Resource: SegmentPort with ID: e6329052-d285-488b-88cb-7c16a57a7be3 is going to be updated. [ 1635.360876] env[70013]: DEBUG networking_nsxv3.common.locking [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1635.361093] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1635.361169] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1635.361400] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1635.361623] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1635.361834] env[70013]: DEBUG oslo_concurrency.lockutils [None req-7579d2b3-3547-44c7-b9bd-a64b6ef6ddca None None] Releasing lock "port-e6329052-d285-488b-88cb-7c16a57a7be3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1636.216168] env[70013]: INFO networking_nsxv3.common.synchronization [req-ac87fe98-d810-4a20-9cc0-ae7e4e77d9cb req-5394f1f7-d0e9-466e-b838-bf183e86935a service nova] Enqueued Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_rules [ 1636.216401] env[70013]: INFO networking_nsxv3.common.synchronization [req-ac87fe98-d810-4a20-9cc0-ae7e4e77d9cb req-5394f1f7-d0e9-466e-b838-bf183e86935a service nova] Enqueued Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_members [ 1636.216490] env[70013]: INFO networking_nsxv3.common.synchronization [req-ac87fe98-d810-4a20-9cc0-ae7e4e77d9cb req-5394f1f7-d0e9-466e-b838-bf183e86935a service nova] Enqueued Resource ID: e6329052-d285-488b-88cb-7c16a57a7be3 with Priority: HIGHEST for action port [ 1636.216697] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_rules [ 1636.216839] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_members [ 1636.216936] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6329052-d285-488b-88cb-7c16a57a7be3 with Priority: HIGHEST for action port [ 1636.217489] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1636.217621] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1636.217681] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1636.217878] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1636.217959] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1636.219124] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1636.219238] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1636.219303] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1636.219470] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1636.219616] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1636.219712] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1636.219776] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1636.219922] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1636.220017] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1636.220105] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1636.220793] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock port-e6329052-d285-488b-88cb-7c16a57a7be3 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1636.220906] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e6329052-d285-488b-88cb-7c16a57a7be3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1636.220974] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e6329052-d285-488b-88cb-7c16a57a7be3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1636.221235] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e6329052-d285-488b-88cb-7c16a57a7be3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1636.221235] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e6329052-d285-488b-88cb-7c16a57a7be3',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1636.722883] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1636.723951] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84 taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1636.724070] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1636.724250] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e6329052-d285-488b-88cb-7c16a57a7be3 with status ACTIVE [ 1636.724406] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1636.724512] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1636.724577] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1636.724783] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1636.724873] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1636.725052] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1636.725150] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1636.725211] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1636.725368] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1636.725448] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1636.725630] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1636.725723] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1636.725784] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1636.725922] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1636.725997] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1636.726688] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e6329052-d285-488b-88cb-7c16a57a7be3 is going to be updated. [ 1636.751263] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1636.751401] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1636.751456] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1636.751651] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1636.751786] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1636.751931] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e6329052-d285-488b-88cb-7c16a57a7be3" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1637.229219] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1637.731850] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1637.732095] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1637.732095] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1637.732319] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1637.732443] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1637.732584] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 is going to be updated. [ 1637.760709] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1637.760900] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1637.760975] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1637.761274] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1637.761482] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1637.770303] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 in Status: IN_PROGRESS for 2s [ 1639.781185] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 in Status: SUCCESS [ 1639.781530] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1639.781595] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1639.781795] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1639.781995] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1639.782122] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1639.782190] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1639.782350] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1639.782434] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1639.782551] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1639.782648] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1640.284797] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1640.787301] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 923a7efd-ce94-46c5-bff5-df5bd6dfdb84: rpc.has_security_group_logging(os_id): False [ 1640.805077] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1640.805266] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1640.805338] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1640.805561] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1640.805674] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1640.805961] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1640.806075] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1640.806140] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1640.806291] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1640.806367] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1640.806456] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 is going to be updated. [ 1640.864448] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1640.864605] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1640.864678] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1640.864899] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1640.865061] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1640.881698] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 in Status: IN_PROGRESS for 2s [ 1641.217709] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1641.217873] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1642.901426] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 in Status: SUCCESS [ 1642.901885] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1646.218951] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1646.219364] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1651.220368] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1651.220793] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1652.264344] env[70013]: INFO networking_nsxv3.common.synchronization [req-cb63a9c9-f16c-4f52-b022-8d4d21283757 req-8082780a-be37-4b0a-9373-3b0e010b1b6a tempest-ServerActionsTestOtherB-172314067 tempest-ServerActionsTestOtherB-172314067-project-member] Enqueued Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_members [ 1652.264780] env[70013]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 with Priority: HIGHEST for action security_group_members [ 1652.265097] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84 taken with stack trace [, , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.265217] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.265564] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.265564] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.265628] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.265699] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.265765] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.265982] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.266182] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.266290] env[70013]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('923a7efd-ce94-46c5-bff5-df5bd6dfdb84',) {} {{(pid=70013) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1652.768874] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.769086] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.769086] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.769286] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.769378] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.769581] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.769694] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.769759] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.769913] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.769993] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.770094] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 is going to be updated. [ 1652.800227] env[70013]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70013) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1652.800385] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1652.800385] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1652.800552] env[70013]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1652.800682] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1652.808356] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 in Status: IN_PROGRESS for 2s [ 1654.819310] env[70013]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 in Status: SUCCESS [ 1654.819687] env[70013]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 923a7efd-ce94-46c5-bff5-df5bd6dfdb84 deletion is rescheduled due to dependency. [ 1654.819687] env[70013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-923a7efd-ce94-46c5-bff5-df5bd6dfdb84" {{(pid=70013) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1657.266015] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1657.266432] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1662.267078] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1662.267472] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1667.268317] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1667.268682] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1672.269734] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1672.270064] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1677.271438] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1677.271839] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1682.272450] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1682.272450] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1687.273876] env[70013]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1687.273876] env[70013]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0